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1 = Why Read This Book 


I sometimes feel inclined to apply the historical method to the multiplication table. 
I should make a statistical inquiry among school children, before their pristine 
wisdom had been biased by teachers. I should put down their answers as to what 6 
times 9 amounts to, I should work out the average of their answers to six places of 
decimals, and should then decide that, at the present stage of human development, 
this average is the value of 6 times 9. 

P. E. B. JOURDAIN, The Philosophy of Mr B*rtr*nd R*ss*il. 


The people that economists write about do not use historical-method mul- 
tiplication tables; they do arithmetic right. They are, it is said, rational. 
Economists write about such people because of what Arrow (1951, p. 406) 
identified as “the general tradition of economics, which tends to regard 
rational behavior as a first approximation to actual.” 

Why, then, do economists so frequently disagree in their predictions of 
what rational people will do? The reason is simply, as von Neumann and 
Morgenstern (1944, p. 9) have stated, “that there exists, . . . no satisfactory 
treatment of the question of rational behavior.” And a little reflection will 
show that treating this question satisfactorily is no small problem. 

There are, to be sure, occasions when the problem of rationality is not 
difficult. For a Robinson Crusoe alone in a world of certainty there is an 
unambiguous correspondence between actions and outcomes; every action 
by Crusoe is associated with an outcome that it brings about. If we define 
“outcome” broadly enough to include everything Crusoe cares about (in- 
cluding the exhilaration or exhaustion needed to bring it about), then all 
economists would predict that Crusoe would take the action associated with 
the outcome he most desires. Everyone would call such behavior rational. 

The one-person world with certainty is a world in which we can talk 
about rationality without trepidation. For every action by Crusoe, there is 
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only one outcome; and so the rational Crusoe will choose the action with 
the best outcome. This idea is the basic principle of rationality. 

When Mother Nature or Friday enters the picture, however, outcomes 
will depend on their actions as well as Crusoe’s. Crusoe’s actions will no 
longer be linked uniquely to outcomes. Whether Crusoe wants to go swim- 
ming will depend not only on his preferences for aquatic exercise, but also 
on whether Mother Nature has placed man-eating sharks nearby; whether 
he wants to make marmalade will depend on whether Friday has made 
toast. “The action with the best outcome” will no longer be clear for Crusoe; 
how Crusoe will act and what action is rational will no longer be clear for us 
observers. Generalizing rationality from the one-person world is not easy. 

The tradition of economics has been to treat a many-person world as 
a collection of simultaneous one-person worlds. Economists would study 
poker as a collection of simultaneous games of a suitably defined variant of 
solitaire. This tradition is a reasonable response to the complexity of the 
many-person world. Just as the best place to search for a lost dime on a 
dark street is under a street light (to mangle Tobin’s simile) so the best 
place from which to investigate rationality in a many-person world is under 
the relatively bright light of what we know (and we know quite a bit) about 
rationality in a one-person world. 

Using this light is what has made economics different from other social 
sciences such as psychology and sociology, which tend to wander around in 
the dark. Many worthwhile results have been found beneath the street light 
of one-person world rationality, and it is the goal of this book to find a few 
more pieces of change—some change people did not expect to be there — 
under that street light. We look there because we are, quite frankly, afraid 
to venture into the dark. 

But while economists are agreed about using the light of one-person 
world rationality to discuss rationality in many-person worlds, they are not 
agreed on how to use it. A many-person world should be treated as a 
collection of one-person worlds, but what collection? This is the question 
that divides economists. 

Nash (1950, 1951), for instance, asks us to imagine that each person ina 
many-person world acts as if the actions of all other people are fixed. Then 
outcomes are uniquely linked to the person’s action, and each, we may as- 
sume, takes the action with the best outcome. Similarly von Neumann and 
Morgenstern (1944) ask us to imagine that each person acts as if, whatever 
action he or she chooses, everyone else will get together and choose a set of 
actions that will make him or her as bad off as possible. Since this paranoia 
makes everyone else’s action depend on the action of the person we are con- 
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cerned about, it makes outcomes solely dependent on that person’s actions, 
and thus creates (for each person) a one-person world in which rationality 
is well defined. (Extending this analysis to some of the cooperative game 
theory solution concepts is more difficult, but is done in chapter 2.) 

The best known trick for turning many-person worlds into collections of 
simultaneous one-person worlds is due neither to Nash nor to von Neumann 
and Morgenstern, but to Walras. Each Walrasian agent acts as if all other 
agents were vending machines, giving out goods and services in amounts 
exactly proportional to the amounts of goods and services that the agent 
gives them. Theories of monopolistic competition use the Walrasian trick, 
but do not require that vending machines maintain exact proportionality 
between receipts and disbursals. Microeconomics has come to be almost 
synonymous with the Walrasian tradition. 

Keynes and his followers used still another method to decompose many- 
person worlds into collections of one-person worlds. Unfortunately, though, 
Keynes did not explicitly state his theory of rationality and dealt instead 
only with its consequences, which at the time were of the utmost impor- 
tance. The result of this lacuna has been the emergence of a distinct division 
of economics, macroeconomics, whose existence without a theory of ration- 
ality has remained an embarrassment to the profession: 


Mathematical general equilibrium theorists have at their command 
an impressive array of proven techniques for modelling systems that 
“always work well.” Keynesian economists have experience with model- 
ling systems that “never work.” But, as yet, no one has the recipe for 
modelling systems that function pretty well most of the time but some- 
times work very badly to coordinate activities. And the analytical de- 
vices and routines of neo-Walrasian general equilibrium theory and 
Keynesian theory will not “mix.” (Leijonhufvud, 1976, p. 103) 


This embarrassment has intensified in recent years because the success of 
macroeconomics in providing useful policy advice—the record that could 
be used to silence its theoretically inclined detractors—has diminished. 
Fisher (1976, p. 4) expresses a common sentiment: “I yield to few econo- 
mists in my ignorance of the causes or cures for the situation of combined 
recession and inflation which has troubled our economies in recent years, 
but I cannot help suspecting that the apparent partial failure of macro- 
economic analysis to cope with it may stem from the attempt to go on 
dealing at an aggregate level with general equilibrium questions involving 
relatively detailed microconsiderations.” 

This book tries to solve the problem of macroeconomics’ embarrassing 
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lack of a foundation in explicit rationality. It uses a new concept of ration- 
ality--a new way of decomposing many-person games into collections of 
one-person games —to do so. This concept turns out to include all the other 
types of rationality that have been used heretofore as special cases. To illus- 
trate the power of the methods we propose, we develop a macroeconomic 
model from first principles. 

Of course, the problem of reconciling macroeconomics with a theory 
of rationality has by no means been neglected by other writers. In par- 
ticular, the contributions of Clower (1965), Leijonhufvud (1968), Barro and 
Grossman (1971), Dréze (1975), Boehm and Lévine (1976), and Malinvaud 
(1977), inter alia, have shown how some Keynesian results can be obtained 
by modifying Walrasian rationality to allow for quantity constraints (vend- 
ing machines with depletable stocks). My debt to these writers is immense. 
Most of the macroeconomic results in this book will be similar to those of 
the quantity constraint school, but will be placed in the broader context, 
and acquire the firmer foundation, of a more general and explicit view of 
rationality. 

Why bother? Because macroeconomic problems are serious ones and 
economists have no good ways of attacking any kind of problems, except in 
the light of rationality. Over the last decade macroeconomics has not en- 
joyed the same degree of success that microeconomics—a theory firmly 
based in rationality —has. This disparity strongly suggests that reconciling 
macroeconomic theory to explicit rationality will improve macroeconomic 
policy. Good theories make good practices —that is our hope at any rate. 


But what makes theories good? Surely this question must be answered if 
we are to try to improve on existing theories. 
The first desideratum is simplicity: 


All scientific activity amounts to the invention of and the choice among 
systems of hypotheses. One of the primary considerations guiding this 
process is that of simplicity. Nothing could be much more mistaken 
than the traditional idea that we first seek a true system, and then, for 
the sake of elegance, seek a simple one. We are inevitably concerned 
with simplicity as soon as we are concerned with system at all; for 
system is achieved just to the extent that the basic vocabulary and set 
of first principles used in dealing with the given subject matter are 
simplified. (Goodman, 1958, p. 1064) 
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Theories that are as complicated as their subject matter do nothing to ex- 
plain or elucidate that subject matter; they merely substitute one complex 
morass for another. “Frustra fit per plura quod potest fieri per pauciora.” ! 
Consideration of the following two very short “theories” provides a star- 


tling example of the potency of simplicity: 


Theory A. Humans shot in the heart always die. 
Theory B. Humans shot in the heart always die, except for you tomorrow. 


The two theories are observationally equivalent today; the only difference 
between them is that theory A is simpler than theory B. Many philosophers 
therefore take the strong willingness of almost everyone to act on the pre- 
cepts of theory A rather than theory B as evidence of the compelling power 
of simplicity. 

There is no consensus on what simplicity is.’ Just counting axioms, for 
instance, will get us nowhere. Rudner (1966, p. 45) points out that “the 
number of axioms (assuming it is finite) of any formulation can be trivially 
reduced to one by the simple operation of conjunction. By the criterion of 
number of axioms every formulation would thus be equivalent to one that 
was maximally simple. . . . Nor would it be possible to ameliorate this 
unwelcome result by any stipulation regarding the number of conjuncts in a 
set of axioms. For, any pair of conjuncts may be trivially reduced to a 
corresponding unconjoined statement by appropriate definitions involving 
the predicates originally contained in those conjuncts.” 

Intuitively, though, we may speak about two aspects of simplicity. The 
first is scope. The wider a theory’s scope, the fewer theories are needed to 
explain the subject matter within its scope. Thus a single theory—a single 
concept of rationality—for both macro- and microeconomics is ipso facto 
desirable, as long as it is more simple than the conjunction of the prevailing 
macro- and microtheories. The second aspect of simplicity is ontological 
parsimony: “Pluralitas non est ponenda sine necessitate,” as William of 
Occam put it. Primitive terms should be as few as possible. 

The second major desideratum for a theory is empirical accuracy. Not all 
propositions in a theory need to be empirically testable, but there should be 
some that are, and these should be true. This requirement distinguishes our 
quest from pure logic or mathematics. 


1. This is a form of the Razor that Occam himself used. The commonly quoted version, 
“Non sunt multiplicanda entia praeter necessitatem,” is an eighteenth—century paraphrase. 
See Thorburn (1918). 

2. For a dissenting view, see, e.g., Reichenbach (1968). 

3. For attempts to answer this question, see, e.g., Goodman (1958), Rudner (1961), 
Ackermann (1960), Kemeny (1955), Putnam (1975), Boyd (1973), and Sober (1975). 
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It also means that when we choose among concepts of rationality, it will 
be equilibria we are concerned with. By equilibrium we mean a state where 
all people are acting rationally (for a particular definition of rationality). 
Postulating a definition of rationality is thus equivalent to predicting that 
only equilibria under this definition will occur. Approaches to rationality 
that cannot give rise to equilibria are thus clearly defective. Similarly we 
may say, e.g., that the existence of unemployment argues against Walras’s 
definition of rationality, since no Walrasian equilibrium has unemployment, 
and that the existence of trade argues against Nash’s definition of rationality, 
since all Nash equilibria are autarkic. 

Notice, then, that we do not judge rationality definitions by how satisfying 
they are to introspection, or by how plausible the accompanying stories of 
out-of-equilibrium adjustment appear, especially when that out-of-equilib- 
rium adjustment is not governed by the rationality definition itself. Most 
definitions are radical failures on both these counts anyway (does anyone 
really do calculus in the grocery store?). 

Our goal, therefore, is to find a simple definition of rationality that has as 
equilibria the kinds of things we observe happening in the world. 


II 


The way we try to do this is through game theory. Essentially, the approach 
follows Shubik’s (1975) suggestion that macroeconomics be analyzed with 
the tools of noncooperative game theory. There are two reasons, closely 
related to each other: the first is that game theory has a concept, that of a 
strategy, that makes questions of time tractable; the second is that game 
theory was explicitly designed for talking about rationality in cases where 
agents are mutually interdependent and conscious of their mutual interde- 
pendence. Such phenomena abound in macroeconomics. Consider, for in- 
stance, Keynes’s stock market (1936, pp. 155-156): 


Nor is it necessary that anyone should keep his simple faith in the 
conventional basis of valuation having any genuine long-term validity. 
For it is, so to speak, a game of Snap, of Old Maid, of Musical Chairs 
—a pastime in which he is victor who says Snap neither too soon nor 
too late, who passes the Old Maid to his neighbour before the game is 
over, who secures a chair for himself when the music stops. . . 

Or, to change the metaphor slightly, professional investment may 
be likened to those newspaper competitions in which the competitors 
have to pick out the six prettiest faces from a hundred photographs, 
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the prize being awarded to the competitor whose choice most nearly 
corresponds to the average preferences of the competitors as a whole; 
so that each competitor has to pick, not those faces which he himself 
finds prettiest, but those which he thinks likeliest to catch the fancy of 
the other competitors, all of whom are looking at the problem from the 
same point of view. It is not a case of choosing those which, to the best 
of one’s judgment, are really the prettiest, nor those which average 
opinion genuinely thinks the prettiest. We have reached the third 
degree where we devote our intelligence to anticipating what average 
opinion expects average opinion to be. And there are some, I believe, 
who practice the fourth, fifth and higher degrees. 


Infinite regress—lI believe that you believe that I believe that you believe, 
etc.—is a problem at the heart of game theory, and game theory’s tech- 
niques have been deliberately designed to describe rationality in its presence. 
Indeed, game theorists were the first to raise the fundamental question of 
what rationality really is, and have supplied most of the answers to this 
question. 

This book, then, is about game theory in the wide sense that it attempts to 
describe rationality in non- Walrasian ways in situations involving mutually 
interdependent conscious actors. 

The book incorporates from game theory a distrust of the concept of 
“expectations,” an idea that has played a major role in macroeconomics, but 
has never played such a role in game theory. This distrust is not of the 
literary use of the term—changing any specification of rationality from 
“agents act as if” to “agents act as if they expect” changes nothing. What is 
objected to, and what is missing from game theory, is the view that agents 
act as if the actions of other agents were determined by chance, with 
probabilities somehow related to some set of external objective events. “Ex- 
pectations” here are used to relate the objective events to unobservable 
probability distributions in agents’ heads, and these unobservables in turn 
determine how each agent associates his or her actions with outcomes. 
Occam’s Razor argues against such a two-step process, and the issue is 
examined in more detail in chapter 5. 


Ill 


Such is the approach around which the book is built. We begin our discus- 
sion, then, in the next chapter with a broad view of the rudiments of game 
theory. This is a necessary preliminary. Particular attention is paid to the 


8 WHY READ THIS BOOK 


various definitions of rationality —or, as they are more usually known, solu- 
tion concepts —that have been used and how they have difficulty in coming 
to grips with macroeconomic problems. 

The third chapter introduces and develops the solution concept we will be 
using, which we call “commitment equilibrium.” It also relates this solution 
concept to the von Neumann-Morgenstern and Nash concepts, and shows 
how any equilibrium of a system built on any imaginable version of indi- 
vidual rationality must be a commitment equilibrium. Appendix B extends 
the idea of commitment equilibrium to games where some commitments 
may be impossible. 

The fourth chapter extends our results in chapters 2 and 3 to games 
involving time, ignorance, and uncertainty. 

In the fifth chapter we consider in detail the various ways people have 
proposed to relate objective events to internal expectational numerical 
probabilities, and demonstrate the pitfalls of this approach. 

In chapter 6 and its sequelae (including Appendix A, on social contracts 
and crime) we turn to the consideration of particular games and particular 
equilibria these games may possess. In the sixth chapter we use some very 
simple examples to show how commitment equilibrium works in economic 
games. We also develop a method for dealing with more complex games; 
this method, moreover, permits us to see easily how Walrasian equilibrium 
is related to commitment equilibrium. 

Building on chapter 6, chapter 7 introduces time into the analysis of 
economic games, and studies a series of increasingly more complicated 
problems. We see here for the first time how commitment equilibria with 
involuntary unemployment can occur. In chapter 8 we first show how large 
numbers of agents need not obliterate non- Walrasian results, and then go 
on to examine the workings of trade unions and the economics of discrimi- 
nation. 

Chapters 9 and 10 present a macroeconomic model that is complicated 
enough to include such things as money, banks, stocks and bonds, capital, 
and embodied technological progress. It is, though, a model, not the model. 
Our goal, after all, is primarily methodological: we are building foundations, 
not houses. But methods are justified only by their uses, and something 
would be seriously wrong with a foundation if no house could be built upon 
it. The easiest and most convincing way to show that a house can be built is 
to build one, and that is what we do in these chapters. The house we 
happen to build for illustrative purposes, then, is not the only type of house 
that can be built on these foundations; the construction will have succeeded 
if it convinces more expert builders that their laboring to erect a better 
house on these foundations is not likely to be in vain. 
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Chapter I0, because it deals with macroeconomic policy, also investigates 
the sort of advice that economists can give, both to well-meaning govern- 
ments and to well-meaning citizens. The latter question, while not novel, 
has not received much attention recently. 

Just-wage and just-price theories have been in disrepute in economics 
ever since Adam Smith argued for the optimality of an equilibrium based 
on unrestrained greed, but there would seem to be no a priori reason for 
such obloquy to carry over into situations where the “invisible hand” does 
not seem to work properly. Biology and medicine have not been diminished 
in scientific stature by giving advice to individuals on matters both private 
(“Wash your hands before eating”) and social (“Don’t urinate on your 
neighbor’s lawn”); why should economics shy away from such activities? 
Indeed, it is often easier to find well-meaning citizens to advise than be- 
nevolent governments. 

The conclusion comes at the end, which is a very good place for it. 

Some sections of the book are quite technical; others are chiefly literary. 
Little mathematical knowledge is assumed beyond standard optimization 
theory, and no knowledge of game theory, but for the technical sections a 
bit of mathematical sophistication and, unfortunately, a generous dose of 
patience are needed. For those who are willing to take their results on faith, 
however, the proofs and technical derivations can be omitted costlessly. 
Model construction, especially in chapters 2, 4, 7, and 9 is also sometimes 
time-consuming, but omitting it is likely to be somewhat more expensive 
than omitting proofs. 

Chapter 3, the discussion of commitment equilibrium, and chapter II, 
the conclusion, contain the book’s central results; even the most impatient 
readers should look at these, although chapter 3’s proofs can of course 
be omitted. Readers whose primary interests are in game theory and phi- 
losophy will find the first five chapters more valuable than the remainder, 
although chapter 6 and Appendix B will also appeal to game theorists, and 
chapter 10 and Appendix C to those with a philosophical inclination. Im- 
patient macroeconomists can concentrate on chapters 7, 9, and 10, while 
impatient microeconomists can look at chapters 6 and 8 and Appendix A. 

There is, though, a certain logic, however slight, to the way the book has 
been put together, and a certain unity, however mystical, to its results; 
reading the chapters in sequence, therefore, has certain advantages. 


ead 
reais nti doer 


a ale oor 


tie . 


7 ver 


mi ¢ 





wyatt 


PART ONE # GENERAL 


2 = Game Theory 


For some minutes Alice stood without speaking, looking out in all directions over 
the country —and a most curious country it was. . . . “I declare it’s marked out just 
like a large chess-board!” Alice said at last. “There ought to be some men moving 
about somewhere—and so there are!” she added in a tone of delight, and her heart 
began to beat quick with excitement as she went on. “It’s a great huge game of chess 
that’s being played —all over the world —if this is the world at all, you know.” 


LEWIS CARROLL, Through the Looking Glass 


Game theory is not the frivolous study that sometimes comes to people’s 
minds when they hear the name for the first time. Parlor games present 
situations in which the rewards to each agent depend on the actions of 
other agents, as well as on the actions of the agent himself or herself. This 
property is not unique to parlor games. What is learned about the formal 
structure of parlor games can be applied in situations that share this inter- 
dependence property. We call serious activities like war, diplomacy, crime, 
and markets “games” not to trivialize them or imply that they are fun, but 
rather to point out that there are general results from the mathematical 
theory of mutual interdependence that may be useful. 

This chapter will provide the reader with the smattering of knowledge 
about game theory that is needed to follow the argument in later chapters. 
We will also state explicitly what we mean by rationality, and show how 
game theory has evolved as an exercise in rationality. Finally, we will note 
why much that has already developed under the rubric of game theory is 
inadequate for the problems we are seeking to address, and why we will 
have to create (in chapter 3) a more general solution concept. 


I 


By a game we will mean here a set of rules. “The game is simply the 
totality of the rules which describe it” (von Neumann and Morgenstern, 
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1944, p. 49). Those rules describe how the actions taken by the persons 
participating in the game —the players —determine the utility they will en- 
joy. The simplest way to summarize a game T and its rules is by a triplet, 
lr = (J, S, f), where / is the index set of players, S is called the strategy 
space, and f is called the payoff function. | tells who plays the game, S tells 
what they can do, and f says what happens when they do it. Games de- 
scribed in this manner are usually referred to as “normal form games,” and 
will be our concern in this chapter. 

Let us be more precise about the constituents of a normal form game. 
The strategy space S contains all the sets of possible actions by the players 
in /. Specifically, a possible action by player / will be called a strategy, and 
the set of all strategies for player i will be called S,, player i’s strategy set. 
In a simple game like Matching Pennies, each player’s strategy set may 
consist of only two simple possible actions —choosing heads and choosing 
tails—while in complex games like those we discuss in chapter 4, strategy 
sets can be enormous and complicated. 

The strategy space S, then, is the Cartesian product of all the players’ 
strategy sets 


S=XS5, 
rel 


and its elements are 1-tuples of strategies, where n is the number of players. 
Such n-tuples of strategies (i.e., the elements of S$) are called situations. A 
situation thus represents a combination of actions that the players in TP can 
take. 

The payoff function / tells what happens to each of the players as a result 
of their choosing a particular situation. Specifically, the payoff function f 
assigns to every situation s in S an n-vector of utilities: 


LS Ri: 


Thus /; (s) is the scalar thac gives player i’s utility when the players in the 
game have chosen the n-tuple of strategies s. What player i gets depends 
not only on his own action, but on the actions of the other players as well 
—and what the other players get depends on what player / does, as well as 
what they themselves do. 

While quite general, the normal form characterization of a game appears 
to neglect the effects of time, uncertainty, ignorance, and information. How- 
ever, we will see in chapter 4, that such appearances are deceiving: appro- 
priate definitions of “strategy,” “player,” and “payoff function” are all that 
is needed. 


GAME THEORY 15 


Il 


We want to think about what it might mean for a player to act rationally in 
a game. We noted in the first chapter that disagreement prevails on this 
matter. Nevertheless it is possible to identify certain elements that all at- 
tempted definitions have, and that anything that somebody wanted to call 
rationality would have to have. To do this, we will have to invent a nomen- 
clature for the general problem of rationality, and relate this nomenclature 
from time to time with nomenclature that has grown up around specific 
approaches to rationality. 

Rationality in games is a problem, it will be recalled, because players can 
choose only their own strategies, while utility is ascribed only to situations. 
For a player to decide on an action, he should know its consequences for 
him, and to know those consequences he needs to know what the other 
players will do. Every definition of rationality, therefore, must establish for 
each player a set of what we will call response correspondences that reflect 
what he is supposed to believe about what the other players will do. A 
player may have more than one response correspondence. Since a set of 
response correspondences is sufficient to determine a definition of ration- 
ality, most controversies in economics are about what the proper set of 
response correspondences is. 

Specifically, for each player i we will define S_, as the strategy space of all 
the other players: 


‘egasuey (Ghva 
kK+i 
Since player i may have several response correspondences, we will index 
the different response correspondences by /: thus q;;(+) will denote the j-th 
response correspondence of player i. (When a definition of rationality speci- 
fies only one response correspondence for a player we will omit the second 
subscript.) Each response correspondence is a mapping from S; to S_;: 


GS; 85 - 


it assigns to every strategy for i a set of plausible responses by the other 
players. 

Sometimes it will be more convenient to talk about response correspon- 
dences in a slightly different way. Associated with each one q;;(-) of player 
i’s response correspondences is a set T;; called the interesting set for player 


i and response correspondence j. T;; © S consists of all situations of the 
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form (s,, s_,) where s_, © q,,(s,). These are the situations that are plausible 
to i under response correspondence /. 

A situation s © 7,, is worthy for i at response correspondence j if no 
other situation in 7,, is better for 7. Thus s is worthy for i at response 
correspondence j/ iff: s © 7, and f,(s) = f,(§) for all § © T,. Worthy 
situations are the best that are plausible for i, and we would expect that he 
would act to achieve them. 

A situation will be called worthy for i if it is worthy for i at some response 
correspondence. 

A situation is an equilibrium if it is worthy for all players. 

We are interested in equilibria because we expect that people will act 
rationally —that is, they will try to bring about worthy situations. If a player 
finds himself at a situation that is not worthy, he will do better for himself 
by changing strategies, since there is an interesting situation where he can 
do better. (Note also that all equilibria are in some sense “rational expecta- 
tions equilibria”: each player must find all the other players acting exactly 
as he expects them to act under some response correspondence, for if he did 
not the situation would not be interesting to him, and situations that are 
not interesting cannot be worthy.) 

If people act rationally, then, the situation we observe will be an equi- 
librium. We want our definitions of rationality to have equilibria, at least 
in the games we are most concerned about, because if they do not it is 
inconceivable that people could ever act rationally. We also want the situa- 
tions our rationality definitions point up as equilibria to resemble the situa- 
tions that actually occur in “the real world”; for if they do not we cannot 
maintain that people in “the real world” are acting rationally. 

In the remainder of this chapter we will look at some types of games and 
some proposed rationality definitions in this light. 


Ill 


One-person games are easy to analyze because there is no need for response 
correspondences. All situations are interesting; the situations that maximize 
the player’s utility are worthy; those situations are equilibria; and the strate- 
gies that are identical to those situations are rational. We expect that the 
player will act to maximize utility. If the payoff function does not achieve a 
maximum over S no equilibrium will exist; if it does, but f and § are 
sufficiently complicated, the task of computing an equilibrium can be tedi- 
ous; but otherwise one-person games present no problems. 
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IV 


There are no problems in defining rationality in another class of games as 
well: two-person constant-sum games. These are games with two players, | 
and 2, which have the property that for every s € S, 


fi(s) tA(s)=K 


for some constant K. Without loss of generality we take K = 0: 


fi (s) +f (s) = 0. (1) 


In the next chapter we will see precisely why there is agreement about 
this class of games. Often the agreement is attributed to the overwhelming 
elegance of von Neumann and Morgenstern’s pioneering treatment of the 
subject, which had a considerable effect, but we will see that there are more 
objective forces at work as well. 

Von Neumann and Morgenstern used only one response correspondence 
for each player: 


NM ne Rees A 
Gi. Sy) arg part Ai(S,, $2) 
Sy SO) 


Che (s.) = arg min A(S,, 82). 


Thus 
(eee = {(5,, 52)|s. = arg nee As, 5)} 
Tr” = (5, )|s, = arg min f(5,, 5)}. 


Players who are rational in von Neumann-Morgenstern’s sense act as if 
their opponents will do everything in their power to harm them. Since 
harming one’s opponent is synonymous with helping oneself in constant- 
sum two-person games, such a definition has considerable intuitive appeal. 

Is it conceivable, though, that both players could act rationally? This is 
the question of whether an equilibrium exists with this type of rationality. 
Suppose, then, that s is an equilibrium. Then it is worthy (maximal in 
T;"") for both players: 


fi(s) = max min f,(5,,5,) 
Geo, Gee 
f(s) = max min f,(S,,5,). 


ES, S,ES, 
Brom ()73(8) = =f, (5), so 


f(s) = max min (—f,(5,,5,)) 
SES, Ses 
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5,€S, ‘ 


= .—fi(s)- 


Thus an equilibrium exists iff /, (+) is such that there is some s with 


ES, 


f(s) = min max f\(5,,5;) = max min /,(§,,5,). (2) 
3,ES, 5,ES, §,ES, HES, 

If (2) holds, s is said to be a saddle-point of f,, and is an equilibrium. 
That /, have a saddle-point is a necessary and sufficient condition for an 
equilibrium. 

Since we have placed no restrictions on /,, other than that it map from S 
to R, it should not be surprising to learn that for some games /, has a 
saddle-point, and for some games it does not. The former are called strictly 
determined games; an example of such a game is 


Player 2 


Player | 





(Player | may be imagined as choosing a row and player 2 as choosing a 
column. The number in the lower left-hand corner of a cell is player I's 
payoff when he chooses the row and player 2 chooses the column inter- 
secting at that cell; the number in the upper right-hand corner is player 2’s 
payoff.) In this game, the equilibrium is (s;, s}). 

There are, however, large classes of games that are not strictly deter- 
mined and hence would appear to lack equilibria. Consider, for instance, 
the game of Matching Pennies: 


Player 2 
Heads Tails 
Heads 
Player | 


Tails 
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(Each player chooses heads or tails. If the players’ choices match, player | 
wins; if they differ, player 2 wins.) Von Neumann-Morgenstern rationality 
would seem to be useless for these games, since it is not conceivable that 
both players could act rationally. 

Von Neumann and Morgenstern showed, however, in essence that all 
games whose strategy spaces and payoff functions met certain convexity and 
continuity requirements had equilibria, and most importantly, that every 
finite game that did not have an equilibrium could be easily associated with 
a game that did. (A finite game is a game where || is finite.) 

The game that von Neumann and Morgenstern associated with every 
finite game is called its mixed strategy extension. This is a game where 
players choose, instead of actions simpliciter ( pure strategies), only proba- 
bility distributions (mixed strategies) for choosing pure strategies; their 
payoffs are then the expected payoffs that result from the mixed strategies 
they have chosen. Specifically, if (J, D, h) is a finite game in pure strategies, 
then (J, S, f) is its mixed strategy extension where: 


SS {7 20| % p=}, 
j€D, 


the | D;|-dimensional unit simplex, and 


Oreo n= ac: D, [ED ex] ies) 


HED, h€D, ED, 

Von Neumann and Morgenstern’s famous “Minimax Theorem” states 
that every mixed-strategy game has an equilibrium. Thus their concept of 
rationality is applicable for all zero-sum two-person finite games. This result 
was first stated and proved in von Neumann (1928) and was extended to 
classes of games with infinite strategy sets by Ville (1938). Von Neumann 
(1953) saw this theorem as the fundamental result of game theory. We will 
not present a proof here; the interested reader may consult virtually any 
standard work on game theory, e.g., von Neumann and Morgenstern (1944, 
pp. 128-158), Luce and Raiffa (1957, pp. 385-393), Owen (1968, pp. 17- 
24), and Vorob’ev (1977, pp. 21-23). 


V 


An alternative type of rationality for two-person constant-sum games is 
that of Nash (1950). A player who is rational in Nash’s sense acts, not as if 
his opponent is out to hurt him, but as if his opponent will never change. 
Nash equilibria and von Neumann-Morgenstern equilibria, however, are 
identical for two-person zero-sum games. 
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Formally, Nash’s rationality uses a system of multiple response corre- 
spondences. In fact, player | has a response correspondence for every one 
of player 2’s strategies, and player 2 has a response correspondence for 
every one of player I’s strategies. These response correspondences, however, 
are very simple: player I’s response correspondence associated with a par- 
ticular strategy of player 2 has player 2 choosing that strategy no matter 
what player | does. Since each response correspondence is associated with 
a unique strategy of the other player we can index the response correspon- 
dences by those strategies. Thus suppose that s},53,53,...,84,...are player 
2’s strategies. Then we will call player I’s response correspondences q’, (), 
Dal)s Tei C)s- ++ Vivi (*)s-+.5 Similarly for player 2. 

Nash rationality, then, uses the following response correspondences: 


qiy(5;) SS for all s, € S; 
for player 1; and 
q>,, (83) = Sy for all s, € S, 


for player 2. 
A situation s is worthy for player | at response correspondence s,, then, 
iff: 


Ai(s) 2 fi(Si,52) for all, 3," Sasy (3) 


A situation is worthy for player | if (3) holds; similarly for player 2. There 
is a special word for situations that has been used for situations that are 
worthy in Nash’s sense: acceptable. From (3) we see that if a situation is 
acceptable to a player he is doing as well as he can, given what the other 
player is doing. 

A Nash equilibrium (sometimes abbreviated NE) is, of course, a situation 
that is acceptable (i.e., worthy) for both players. If (s, , 5, ) isan NE, s; must 
be a best strategy for player | given that player 2 is choosing s, and s; must 
be a best strategy for player 2 given that player | is choosing s,. Neither 
will change unless the other does also. 

It is easy to show that Nash and von Neumann-Morgenstern equilibria 
coincide for all constant-sum two-person games. 

First we will show that all Nash equilibria are von Neumann-Morgenstern 
equilibria. That is, we will show that if (s, , s)) isa Nash equilibrium it must 
be worthy for both players in the von Neumann-Morgenstern sense. Since 
(s,, 5.) is an NE, it is acceptable to player 2, and hence 


ANAS, 52) = —fA 2) = ‘oce AS, 82) = min Ai(S,. 83). 
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Hence s, € qi (s,) and (s,, 5) € T)™. For any (5,, g)” (5,)) in 7,™, it 
follows from the definition of g”(-) as a minimizer that 


AGG) SAG.) for all 5, € S). (4) 
Since (s,,5)) is acceptable to player 1, 

Ai(S1.82) 2 AiG. 52) forall, ses Sie 
Combining this with (4) we obtain: 

FASS) = f.G,,¢, “6 for all 5, € S, 


and so (s,, 5, ) maximizes f, (-) in T;”™”. This means it is worthy for player 1. 
A symmetrical argument will establish von Neumann-Morgenstern worthi- 
ness for player 2. Thus (s,, 5; ) is a von Neumann-Morgenstern equilibrium. 

Now suppose (s,, 5, ) is a von Neumann-Morgenstern equilibrium; we 
will show it is a Nash equilibrium. For 


fi(S;,5.) = min max f,(5),5)), 
3ES, §,€S, 
and so 
FiSis 5)! == fp (S552) for all 5, € S, 


by definition of a maximum. Thus (s,, s,) is Nash-worthy for player | at 
response correspondence s, and is acceptable for player 1. From a similar 
argument, (s,, 5) ) is acceptable for player 2. Thus (s,, 5, ) is a Nash equi- 
librium. 

The equivalence between von Neumann and Nash rationality for constant- 
sum two-person games should not be terribly surprising. In these games, a 
gain for one player is automatically an equal loss for the other. Maximizing 
one’s own utility is equivalent to minimizing one’s opponent's, and so the 
requirement that one do as well as possible given what the opponent is 
doing is identical to the requirement that one do as well as possible given 
that the opponent will hurt one as much as possible, since with a rational 
opponent “what the opponent is doing” and “what hurts one as much as 
possible” are the same thing. 


VI 


In two-person constant-sum games, helping oneself is equivalent to hurting 
one’s opponent, but few if any other many-person games share this property. 
In all other games there are advantages to cooperation as well as antagonism. 
No consensus has emerged as to what rationality is in the presence of such 
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phenomena; Shubik (1968) estimated that 20 to 30 different “solution con- 
cepts” for general games had been proposed. 

Both the von Neumann-Morgenstern and Nash definitions of rationality 
can be generalized simply, but so far no one has shown any serious interest 
in the simple generalization of the von Neumann-Morgenstern definition. 
One reason is that paranoia—which is what psychologists would call the 
simple generalization —has had little appeal for economists or game theorists 
as a rule for behavior; another reason is that for many games general 
paranoia may not lead to any equilibria at all. 

The Nash definition has received much more attention. The generaliza- 
tion is simple: instead of indexing response correspondences on the other 
player’s strategy, index them instead (since there is no simple “other player”) 
on (nm — |)-tuples of other players’ strategies. Thus for player i 


qj, (Si) = S-; for all S_; = S_; 
and a situation s is Nash-worthy or acceptable iff: 
AG) = fi. so for all 5; € S;. 


An NE is a situation acceptable to all players; at an NE all players are 
acting rationally. 

Nash (1950, 1951) proved that every finite game has an NE in mixed 
strategies. Glicksberg (1952) extended this result to games with compact 
strategy spaces and continuous payoff functions, while Nikaid6 and Isoda 
(1955) showed that all games with convex, continuous payoff functions have 
NEs in pure strategies. 

Nash’s view of rationality is perhaps the simplest that has been proposed, 
and we will be using it as the foundation for the remainder of the book. 
Serious objections have been raised to it, however. Since NEs do exist for 
most games, these objections are necessarily empirical, if only casually so. 
It is conceivable that people could act in the manner described by Nash, 
but, the objectors insist, they do not, or, more weakly, do not always. Con- 
sider, for instance, the game of prisoners’ dilemma: 


Player 2 


Don’t Confess Confess 


Don’t Confess 
Player | 


Confess 
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(The players are prisoners being held for interrogation on a minor crime. If 
neither confesses to a major crime, they will both receive light penalties for 
the minor crime. If one confesses to a major crime and implicates the other 
in it, while the other confesses to nothing, then the player confessing will go 
free and the player not confessing will receive a very harsh sentence. If they 
both confess to a major crime, they will both receive harsh sentences.) The 
only NE is dual confession, but both players would be better off if neither 
confessed. If people act rationally a la Nash they will always confess and 
never cooperate. But there is, at times, honor among thieves, and coopera- 
tion for mutual advantage among individuals who are neither saints nor 
inmates of lunatic asylums. Situations that are not NEs sometimes occur. 
Cooperation is, in fact, pervasive in modern economic life. Thus Nash’s 
definition of rationality does not seem to be the best one for describing how 
people act. 


Vil 


In contrast to Nash’s so-called “noncooperative” approach to rationality are 
the “cooperative” approaches. Most of these involve sophisticated —not 
simple — generalizations of the von Neumann- Morgenstern rationality defi- 
nition. The original discussions of cooperation used transferable utility. 
Aumann (1961), however, showed how they could be extended to games 
with nontransferable utility, and since games with transferable utility are 
in fact a special subclass of games with nontransferable utility, we will for 
the most part follow his discussion. (There will be two exceptions, for the 
sake of simplification: we will ignore correlation of mixed strategies across 
players, and B-effectiveness.) 

Coalition is a fundamental notion in cooperative game theory. By this is 
meant simply a subset (possibly improper) of the set of players /. Rationality 
in cooperative game theory requires that players try to form coalitions to 
act together to advance their interests. 

Core-rationality, introduced by Gillies (1953), is probably the best known 
and easiest to use form of cooperative rationality. For any player i let V(/) 
denote the set of all coalitions of which 7 isa member: W(i) = {J CJ |i € J}. 
For any coalition J let J — J denote (the coalition that is) J’s complement 
in J, and let 


s’ =(s,), i€J 


denote a |/|-tuple of strategies chosen by the members of J. The set of all 
the s” available to the members of J will be denoted S$”: thus 


ens. 


ieJ 
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Define v(J/) as the set of all situations for which coalition J is effective: 
v(J) = {s € S | (a5 S7)(WET? € ST’) E IVF (5,57) = F(s)}. 


Coalition J is effective for situation s if it has a joint strategy that can 
guarantee all its members at least as much as they receive with s, no matter 
what the remaining players do. (This is Aumann’s “a-effectiveness”; “B- 
effectiveness” reverses the existential and first universal quantifiers.) 

Define v(J/, s;) where J © W(i) as the set of all (7 — 1)-tuples of strategies 
for the players other than 7 which when concatenated with s, result in 
situations for which J is effective: 


v(J,5;) = {si ES; | (5,54) Ev (J)}, JE VO. 


Then the response correspondence assigns to each strategy s, of player i 
all the (7 — 1)-tuples in v(J, s;) for alli J © W(i): 

gi(s;) = \) vG&s;). 

JEW) 
Thus the interesting set is 
TS NAG) 
JEV(i) 

and a situation is core-worthy for player i iff it maximizes his payoff in 7;°. 
That is, at a core-worthy situation a player can find no coalition that can 
guarantee him an increase in payoff. A core-equilibrium, of course, is a 
situation that is worthy for all players. 

A situation s is said to be dominated if for some J, s € v(/) and for some 
FETE (S253) > f; (s). It is easy to show that s is a core-equilibrium iff it 
is undominated. If s is undominated, then there is no § € U, v(J) with 
J (S) >f;(s) for any i, and so in particular there is no § € Ujey, v(J) with 
that inequality. Thus s is worthy for all 7. On the other hand, suppose s 
were dominated. Then /, (57, 57”) > f,(s). By definition (57, 7%) Ev) 
and hence interesting for 7. Thus s is not worthy for i. 

Note that all core-equilibria are Pareto-optimal, because a situation that 
was not Pareto-optimal would be dominated by the coalition of the whole, /. 

For many games, core-equilibria do not exist; for instance, there are 
none in any many-person constant-sum games where cooperation matters 
(see, e.g., Luce and Raiffa, 1957, pp. 194-195). This would be a serious 
defect of core-rationality for us if we were primarily concerned with such 
games; but it is not, as our primary concern in the second part of this book 
is with economic games for which it has been shown that core-equilibria 
exist. 

The general von Neumann-Morgenstern rationality approach is similar 
to the core, but it considers coalition-forming rationality not universally, as 
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the core does, but only relative to some prevailing “standard of behavior.” 
We will represent such a standard of behavior by V, a subset of S; we will 
explain later what requirements we place on V for it to be acceptable as a 
standard of behavior. V is a restriction on each player’s interesting set; the 
new interesting set is: 


ee \) v(F) OV 
JEV(i) 

and worthiness and equilibria are defined as before. We denote by V* C V 
the set of V-equilibria. The requirement that we place on V for it to be 
acceptable as a standard of behavior is that if s is not in V, then for some 
player i and some s* € V*, situations s* and s are both core-interesting, 
but f; (s*) > f;(s). Thus for any V, the set V* of V-equilibria is internally 
stable in the sense that no coalition wants to move from any situation in it 
to any other; if V is a workable standard of behavior, then V* is also 
externally stable in the sense that for every situation not in V* there is a 
situation in V* that some coalition wants to move toward. 

V-equilibria are much more plentiful than core-equilibria. For almost 
every game there is a set V that has V-equilibria, and many games have 
many sets. In the constant-sum three-person game with transferable utility, 
for instance, every situation is a V-equilibrium for some V or another. It 
was once believed that every game had at least one V-equilibrium, but 
Lucas (1968) and others have found a few that do not. 

No situation that is Pareto-inferior to another situation in V can be in 
V*, but V-equilibria in games without transferable utility do not have to be 
Pareto-optimal. V may be a workable standard of behavior even if some of 
its equilibria are Pareto-inferior to situations outside V, because there may 
be other V-equilibria that coalitions can and will enforce against these out- 
side situations. If utility is transferable or close to it, however—e.g., if 
players have available to them strategies like paying each other money or 
some other good— V-equilibria must be Pareto-optimal. The games we 
will be most concerned about—games where people can transfer goods 
and services between each other —are of this type. 


Vill 


One cooperative “solution concept” that does not fit our scheme is “value.” 
Shapley (1953) formulated value for games with transferable utility; Au- 
mann and Shapley (1974) and Aumann and Kurz (1977) extended the con- 
cept to games without transferable utility. Value is a way of assigning a 
utility to the prospect of having to play a game. Given that one is playing 
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the game, value gives no advice about how to play it. It is not necessarily 
even the payoff from a situation in the game, and has nothing to do with 
rationality (once the game has started) or equilibrium. Value will not con- 
cern us in this book. 


IX 


There are several other cooperative approaches to rationality as well, in- 
cluding the Walrasian one, which we will discuss in detail in chapter 6. 
What most of these approaches have in common is a requirement that 
equilibria be Pareto-optimal. Just as the empirical observation of coopera- 
tion was a serious empirical objection to Nash’s rationality approach, so the 
empirical observation of Pareto-inferior outcomes is a serious objection to 
the use of these cooperative concepts. 

Requiring Pareto optimality is a defect, for our study in particular, 
because we wish to study phenomena—unemployment being the prime 
example—where Pareto optimality is violated. We suspect we will make 
little progress if we rule out a priori the existence of the phenomena we are 
supposed to be studying. 

The question we are interested in, then, is why Pareto-inferior results 
can occur in worlds where there is sometimes cooperation — why the coali- 
tion of the whole can’t get together and have somebody say, “Gee, guys, if 
we did so-and-so, everybody would be better off.” To be sure, there are two 
cooperative solution concepts that do not require Pareto optimality: Luce’s 
(1955) “W-stability” and Aumann and Maschler’s (1964) “bargaining set.” 
Both concepts, however, beg the question we are interested in by essentially 
ruling out the formation of certain coalitions a priori. For both of them, for 
instance, the existence of involuntary unemployment among telephone users 
would cause a problem. For it is clear (and was more clear before the recent 
antitrust decision) that the set of American Telephone and Telegraph’s em- 
ployees, shareholders, and customers is a coalition that has in fact formed, 
that is cooperating, and that encompasses virtually the entire U.S. popu- 
lation. How such a coalition could allow Pareto-inferior situations is a mys- 
tery, as long as cooperation is of the all-or-nothing type that characterizes 
the core and V-equilibria. 

In the next chapter, therefore, we go on to a new type of rationality that 
allows us to examine the mechanics of cooperation—as well as the possi- 
bility of noncooperation. The type of rationality needed to deal with the 
cooperative but not perfect world familiar to macroeconomics will, more- 
over, turn out to be a generalization of the types of rationality we have been 
discussing here. 


3 =» Commitment Equilibrium 





It is not those who can inflict the most but those who endure the most who will 
conquer. TERENCE MACSWINEY, Lord Mayor of Cork, August 1920, at the beginning 


of his hunger strike in Brixton Prison 


Schelling (1960, pp. 120-121) describes the situation: 


. .. of twenty men held up for robbery and ransom by a single man 
who has a gun and six bullets. They can overwhelm him if they are 
willing to lose six of themselves, if they have a means of deciding 
which six to lose. They can defeat him without loss if they can visibly 
commit themselves to a threat to do so, if they can simultaneously 
commit themselves to a promise to abstain from capital punishment, 
once they have caught him. He can deter their threat if he can visibly 
commit himself to shoot in disregard of any subsequent threat they 
might make, or if he can show that he could not believe their promise. 
If they cannot deliver their threat—if, say, he understands only a for- 
eign language—they cannot disarm him verbally. Nor can they make 
a threat unless they agree on it themselves; so if he can threaten to 
shoot any two who talk together, he can deter agreement... . If four- 
teen of the twenty can over-power the remaining six and force them to 
advance, they can demonstrate that they could overwhelm the man; if 
so, the threat succeeds and the gunman surrenders, and even the six 
“expendables” gain through their own inability to avoid jeopardy. 


Coalition formation, indeed any departure in the direction of coopera- 
tion from the thoroughly noncooperative Nash equilibrium, requires com- 
mitments, promises, or threats—the sort of thing Schelling calls strategic 
moves. Strategic moves are the mechanism through which cooperation 
occurs. This chapter will be about strategic moves, or more specifically, 
about rationality with strategic moves. 
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The first section of this chapter will show in an example: how strategic 
moves work; the second will formalize our procedure for dealing with 
strategic moves. It turns out to be more convenient to start with a definition 
of equilibrium and derive a definition of rationality from it, and this is the 
procedure we will follow. The second section therefore defines “commitment 
equilibrium,” and derives some basic results. The third section uses these 
results in a series of examples, while sections four and five provide more 
results for use later in the book. In section IV we show the existence of 
commitment equilibria —i.e., that it is conceivable that people could act in 
the way we are talking about. Finally, in the last section, we tie these results 
in to the discussion of the last two chapters by displaying explicitly the 
definition of rationality that underlies commitment equilibrium, and show 
that all the equilibria we discussed in chapter 2 were special kinds of 
commitment equilibria, and indeed any kind of rationality is commitment- 
rationality. 


I 


If a situation that is not a Nash equilibrium occurs, some player is choosing 
a strategy that is disadvantageous to himself, given what the other players 
are doing. What is there about commitments, promises, and threats that 
allow them to induce contrary behavior? They cannot make inherently un- 
attractive situations more attractive, because that is magic: even if such 
magic existed it would be used to make all situations more attractive, and 
the NE would not be changed. On the contrary, as Schelling (p. 150) argues, 
strategic moves are selective subtractions by a player from his own payoff 
function. 

Suppose, for instance, that I can either play tennis or break your legs, 
and that you can either pay me a hundred dollars or pay me nothing. I 
prefer playing tennis to breaking your legs and you prefer not paying me to 
paying me. This game can be illustrated as 


Don’t pay Pay 


Tennis 


Breaking 
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The only NE of this game is the upper left situation where I play tennis and 
you don’t pay me. In the absence of two-way communication of some sort, 
there is no reason for either of us to deviate from this happy state. 

But suppose—just suppose—that I threaten to break your legs unless 
you pay me a hundred dollars. How do I make this threat, since I in fact 
prefer playing tennis to breaking your legs, even if you don’t pay me? What 
I must do is to subtract 2 or more units from my payoff in the upper left 
situation; then it will be true that I would rather break your legs than play 
tennis if you don’t pay me. The mechanism for carrying out this subtraction 
will not concern us—perhaps my concern for my reputation is such that 
my announcing the threat is sufficient to subtract 2 units from my payoff 
function if I “chicken out,” or perhaps I must engage some sort of external 
enforcer to do me 2 units of harm if I fail. (If there is no mechanism, then I 
can make no threat, for you will merely laugh at me and call my bluff, and | 
will play tennis.) 

After I threaten, then, there is a new payoff matrix: 


You 


Don’t pay Pay 


Tennis 


Breaking 











The new NE is the lower left situation where I break your legs and you 
don’t pay me. Notice that I am worse off here (my payoff is 2) than I was 
before making the threat (my payoff was 3). Given your lack of commit- 
ment of any kind, I was better off not making any threat at all. In this 
sense, the original circumstance of no threats, no paying and no breaking 
was stable. 

But, however foolish my threat may have been, suppose I have made it. 
If nothing else happens, you will find your legs broken, something you find 
quite distasteful, even if you keep your money. What can you do to prevent 
this? You can promise to pay me if I don’t break your legs. How do you 
make this promise? You make it by subtracting 2 or more units from your 
payoff in the upper left situation where I play tennis and you don’t pay. 
Again, the mechanism for this subtraction will not concern us. After my 
threat and your promise the new payoff matrix is: 
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Don’t pay Pay 


Tennis 


Breaking 





The NE is the upper right situation where I play tennis and you pay me. 
Notice now that since you promised to pay me if I don’t break your legs, 

my threat to break your legs if you don’t pay me is no longer foolish. For 

suppose you promised but I didn’t threaten. The payoff matrix would be: 


You 
Don’t pay Pay 


Tennis 


Breaking 





The NE is still the upper right situation where I play and you pay, so my 
threat no longer hurts me. Note, however, that if I don’t make my threat, 
you are better off not promising, because if you promise your payoff will be 
2 at play and pay, and if you don’t promise your payoff will be 3 at play and 
don’t pay. In the absence of my threat, your promise is foolish. 

Thus we have identified two occasions where neither of us is acting 
foolishly: 


No commitments, I play tennis, you don’t pay. 
I threaten and play tennis, you promise and pay. 


Soon we will learn to call these occasions “commitment equilibria.” What 
makes these occasions special is that no player would want to change his 
commitment, given what the other player’s commitment is, nor would any 
player want to change his strategy, given his own commitment and the 
other player's strategy. Commitment equilibrium will represent our basic 
approach to rationality. 
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II 


Now we want to incorporate strategic moves into our formal description of 
games. It will be simpler here and throughout to insist that payoffs be non- 
negative; this can be done without loss of generality. Thus let ! = (/, S, f) 
be a game in normal form, where S$ contains no strategic moves and the 
range of f is in the nonnegative orthant of R”. (We will take S and its 
generic element s to include mixed as well as pure strategies whenever 
appropriate; for more detailed discussion see Appendix B.) 

One way we could accomplish this incorporation would be to expand S$ 
to include all possible strategic moves. Schelling (pp. 150-158) used this 
procedure. By giving a special status to strategic moves, however, we can 
obtain more interesting results. 

First we must decide, though, what strategic moves to consider. As 
Schelling illustrates in his discussion of the six bullets and twenty men, a 
player cannot always effect any desired reduction in his payoff matrix. We 
will ignore this difficulty in the sequel, however, and proceed under the 
principle that one can always make oneself thoroughly miserable. This will 
be called the “free disposal of utility” axiom. The reason for this axiom is 
simply to keep our task of manageable size. Systems without free disposal 
are no doubt of great concern, but we will reserve our consideration of 
them to Appendix B. Fortunately we will find there that limitations on 
utility disposal do not necessitate great changes in our basic theory. 

We denote by '* = (J, S, f)* the game that obtains from T' by allowing 
strategic moves under the free disposal axiom. 

In I’*, the players first choose amounts to subtract from their own payoff 
functions in I’, and then the new game after these subtractions is played. 
Precisely, I"* differs from I" in that each player i first chooses a function 


£3255 Ry gi(s) S f(s), Vs eS 


and then the game (J, S, f—g) is played, where g =(g;), i € J. The amounts 
that player 7 subtracts from his payoff function, that is, the function g,, will 
be called i’s commitment; the n-tuple of commitments, that is, the function 
g, will be called the commitment pattern. 

We will be concerned whether any player can improve his payoff by 
changing his commitment. A commitment pattern-situation pair will be 
called beaten if some player, by changing only his own commitment, can 
create a game with an NE more favorable to him than the game with the 
original commitment pattern. 
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Specifically let g and g’ be commitment patterns for (J, S, f)* and let s 
and s’ be situations. Then: 


(g’, s’) beats (g, s) through player i if 


(a) sisan NE of (J, S, f—g) and s’ is an NE of (J, S, f—g’) 


(b) (f, —8/)(s’) > (G4 — g:)(s) and 
(c) g, =e; forall jE Lj Fi. 


(g’,s’) beats (g, s) if there is some player i through whom (g’,s’) beats 
(g,5). 

We will define a commitment equilibrium as a commitment pattern- 
situation pair where no player has any reason to change either his commit- 
ment or his strategy. Thus: 


(g,s) is a commitment equilibrium for (I, S, f)* if 


(a) s isan NE of (J, S, f—g)and 
(b) no(g’s’) beats (g, 5). 


In a commitment equilibrium, as we discussed in the last section, no 
player may change strategies without hurting himself (with other players’ 
strategies and his own commitment held constant), and no player can 
change commitments (with other players’ commitments held constant, but 
all strategies adjusted). Each player’s strategy is his best response to the 
other players’ strategies, and each player’s commitment is his best response 
to the other players’ commitments, when NEs are compared. 


Ill 


Now that we know what they are, we will talk about what commitment 
equilibria are like, and how we can find them. It will shorten presentation if 
we denote by A (i, g) the set of situations that are acceptable to player / in 
(I, S, f—g) and by N(g) the set of situations that are Nash equilibria of (/, 
S, f—g). Clearly 


N(g) = () A(i,g). 


We will also call a situation possible for i in (I, S, f—g) if it is acceptable 
for all players but i in (/, S, f—g). P (i, g) will denote the set of situations 
that are possible for i in (J, S, f—g); L.e.: 


Pti,2)> i A(j,g). 
jel 


Since N(g) = P(i,g)  A(i, g) for any player i, if N(g) is nonempty, 
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P(i,g) must be nonempty for all i, and if N(g) is empty, g is not a 
commitment pattern in which we have any interest. 

Our first theorem tells us that a commitment pattern-situation pair is 
beaten if and only if there is a better situation (in terms of the original 
game) in some player’s possible set. 


Theorem 1. (Possible Point Theorem). Suppose s © N(g) and g;(s) = 0. 
Then (g, s) is beaten through i iff f,(s) < £,(5) for some § © P(i, g). 


Proof. Sufficiency. Suppose /;(5) > f,(s) and § € P(i, g). 


We will show that there is a g such that (g, 5) beats (g,s) through 7. 
Construct ¢ in the following manner: 


=. for j #i 
&:(§) =0 
&(5) =f(S) for 5s #58. 
We need to show that (a) § € N(g), and (b) (f; — g,) (S) > /, — g;) (8). 


Ad (a). Since § € P(i,g), § © A(j, g) for all j #7. But for all these 
players g; is the same as g; and so A(j,g) = A(j,g) and § € A(j, g). 
By construction, § € A (i,g). Hence s is acceptable for all players in 
(1, S, f—&) and § € N(g). 


Ad (b). Since g; (§) = 0 we have 
ee eS) — 7) >S(s) =; —2)6) 


since g;(s) = 0 by hypothesis. Thus we have shown that (g, 5) beats (g, s) 
through player 7. 


Necessity. Suppose (g’, s’) beats (g, s) through i, but that f,(s) = f(S) for 
all § € P(i, g). Then ( f; — gi) (s’) > Cf; — 8:) (s) = f(s) 2 f(S) for all 
§ € P(i,g). Thus s’ € P(i,g). If s’ € P(i, g), there must be some j + i, 
such that s’ ¢ A( j, g). But by definition of beating through i, g; = g/ and 
A(j,g’) = A(j,g). Thus s’ € A(j, g’). Hence s’ € N(g’) and (g’, s’) does 
not beat (g,s) through i. Since this is a contradiction, we have proved 
necessity. @ 


The condition g(s) = 0 in the Possible Point Theorem will be no hin- 
drance to us, as the next theorem shows. It states that players never use 
strategic moves to hurt themselves at commitment equilibria. At equilib- 
rium, no one’s bluff ever gets called. 


Theorem 2. (No Real Suffering). Jf (g, s) is a commitment equilibrium, 
then g(s) = 0. 
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Proof. Suppose (g, s) is a commitment equilibrium, and g,(s)} > 0 for some 
i. Construct g’ in the following manner: 


8 = & for | #1 
gi(S)=g,($) fors #s 
gi(s) = 0. 


We assert that (g’, s) beats (g, s) through i, contrary to hypothesis. To prove 
the assertion we must show: 


(a) s€& N(g’). 


Since s © A(j,g), s © A(j,g’) for j ¥ i by the usual reasoning. It is also 
easy to see that s € A (i,g) implies s € A (i,g’), since 


(fi — gi)(s) = fis) > (i — Bi(s) 2 (Ki — 8) Sie 5-1 
= (fi — 81) Gi, 5-1) 
for all §; #5; in §;. 
(b) (fi — ai) (s) > (4 — 8) (9). 
This is true because g/(s) = 0 < g,(s). 
©) ge, 775 


This is true by construction of g’. Therefore (g’, s) beats (g, s) and (g, s) is 
not a commitment equilibrium. # 


The next result provides our basic tool for finding commitment equilibria. 
We will call a situation good for player i if it maximizes his payoff in his 
possible set. The next theorem states that a situation is associated with a 
commitment equilibrium if and only if the situation is good for all players. 

Specifically, we will denote the set of situations that are good for player i 
by B(i, g): 


B(i,g) = {s © P(i,g)| (V5 © Pli,g)) fils) 2 fi}. 
Then we have the following theorem: 


Theorem 3. (Goodness). (g,s) is a commitment equilibrium of (I, S, f)* iff 
s Ef)\j<, BH, g). 


Proof. Sufficiency. Suppose s © ,<, B(i,g). We need to show (a) s © N(g), 
and (b) (g, 5) is not beaten. 


Ad (a). s © B(i, g) for all i and thus s € P(i, g) for all i a fortiori. Hence 


sEN; Pli, g) =O (jn: AC, 8) = O11, AG 8) = N(g) 
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where the penultimate equality follows from commutative properties and 
the fact that the intersection of any set with itself is itself. 


Ad (b). Suppose (g’, s’) beats (g, s) through 7. Then by the Possible Point 
Theorem s’ € P(i, g) and f;(s’) >/;(s). Then s €¢ B(i, g) and s €(1; B(i, g). 
Since this is a contradiction, the supposition that (g, s) is beaten cannot be 
maintained. 


Necessity. Suppose (g,s) is a commitment equilibrium but that s ¢ 
(1); B(i,g). Then there is some player, say j, for whom s ¢ B(j, g). Either 
s © P(j, g) or not. 

Suppose s € P(j,g). Then there must be some s’ € P(j, g) with f(s’) > 
f(s). But then by the Possible Point Theorem (g, s) is beaten through j and 
cannot be a commitment equilibrium. 

Thus we must suppose s ¢ P( j, g). This means there is a player k #/ for 
whom s €¢ A(k,g). Thus s € N(g) and (g,s) cannot be a commitment 
equilibrium. This contradiction proves necessity. @ 


With the Goodness Theorem, we can show some properties of commit- 
ment equilibria easily. The first property that we want to show is what we 
call individual improvement: no player in a finite game is ever worse off at a 
commitment equilibrium than at the best point he could assure himself of 
on his own. 


Theorem 4. (Individual Improvement). /f (g, s) is a commitment equilib- 
rium of the finite game (I, S, f)*, then for every player i: 


(fi — g:)(s) = f(s) 2 max min f,(8;,5_)). 
Ge) SESE, 


Proof. The first equality, of course, follows from the No Real Suffering 
Theorem. For the inequality, we need to show first that for every 5; € S, 
there is some §_; € S_; such that (5,, 5_;) © P(i, g). 

To show this for an arbitrary 5; € S;, consider the game 


Ded SD SanGim 2)Gs-)) 


i.e., the game played among the other players given that player i has chosen 
§;. Since S$ is finite, S_; is also and I'(S;) is a finite game. Hence by Nash’s 
theorem (1951), '(5;) has an NE; call one of these NEs S_,;. 

We claim (5;, §_;) © P(i, g). Consider a player j #7. Since §_; isan NE of 
I\(S;) it is acceptable to / in that game: 


(Fj Sa 5) rae ee Oi Bj) i515); 5-3 -)) 


for all 5; € S;. (S_, -; is §_; without its j-th component). But this means that 
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(§,, §_,) is acceptable to j in (/, S, f—g). Since j is arbitrary, (§,, §_,) € 
P(i, g). This completes our first claim. 
Now we will show that for every 5; € S; 


Ils) = min Ii; §-i)- (1) 
Since (5,, 5_;) © P(i,g), Goodness tells us 

Si(s) = fii, 5) 
and the definition of a minimum tells us 


fiGp5)= min I(Si. 5-1). 
5-,So-; 


Inequality (1) follows immediately. 
Since §; is arbitrary in (1), the theorem is just an instance of (1). @ 


The Individual Improvement results cannot be extended to infinite games 
unless restrictions are placed on f and g to assure that the appropriate 
auxiliary games I’(s;) have NEs. Consider the following game as a counter- 
example: Let J = {1, 2}, S, = {1, 2}, S, ={x €R| x 2 1}, and 


ACY = ACI) = 10 

ACY) = CEH “tors 1 
fi(2,x) = 15 
b,x) = 2 Cx) 


Let g, (2,x) = 15 for x =] | and g(-) = 0 otherwise. Then it can be verified 
that (g, (1,1)) is a commitment equilibrium even though it is not indivi- 
dually improving for player 1. 

The phenomenon of multiple NEs would seem to present problems for 
the definition of commitment equilibrium. When a game has multiple NEs, 
which one counts for the comparison for which player? The next theorem 
shows that this problem is not a problem at all. If g is a commitment pattern 
that can give rise to a commitment equilibrium, then there is one NE of 
(I, S, f—g) that is better than all others for every player, and it is this NE 
that is relevant: 


force ale 


Theorem 5. (Unquestioned Superiority). (g, s) is a commitment equilibrium 
only if (f, — gi (8s) 2 (fi — 8) (8) for alli € Iand § © N(g). 


Proof. Suppose that for some i € / and § € N(g), 
(fi — eG) < Vi — gi) G6). 


Then (g, 5) beats (g,s) through 7. Hence (g, s) is not a commitment equi- 
librium. 
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A consequence of Unquestioned Superiority is that payoffs are uniquely 
determined by commitment patterns: if two commitment equilibria have 
the same commitment patterns, then payoffs are the same for every player 
at both equilibria. 


Theorem 6. (Same Commitment, Same Payoff). /f (g, s’) and (g, s”) are 
both commitment equilibria of (I, S, f)*, then f(s’) = f(s”). 


Proof. Suppose that for some i € /, 
fi (s’) > fi(s”). 

From the No Real Suffering Theorem, we have 
8(s‘) = g;(s”) = 0. 

Hence 
emer ) =U — 2) 6") 


and by Unquestioned Superiority, (g,s”) is not a commitment equilib- 
rium. @ 


A final result for this section deals with constant-sum two-person games. 
We have already seen that von Neumann-Morgenstern and Nash equilibria 
are the same for these games; now we will see that commitment equilibria 
are also. 


Theorem 7. (Saddle Points). Let (J, S, f) be a finite constant-sum two- 
person game. Then for (I, S, f)*: 


(a) (g, s)is a commitment equilibrium only if s © N(o), i.e., only if s is 
a saddle point. 
(b) Ifs € N(o), then (0, s) is a commitment equilibrium. 


Proof. Ad (a). Suppose (g, s) is an equilibrium. Then by Individual Im- 
provement we have for player 1 


fi (s) 2 max min f,(s;, 53) 
srES; srES> 
and for player 2 
a(S) pmax minis (Sys). 
SES, ES, 
or, from the constant-sum property, 


Ai(s) S min max f(s; 53). 
srES srES, 
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Thus 
min max /f,(s/,s3) 2f\(s) 2 max min /f,(sj,53). 
ssES» siES, sES, ssES; 


But by the Minimax Theorem of von Neumann and Morgenstern 
(1944) 


min max /,(s{,53) = max min f/f, (sj,53). 
sES. siES; sisES,; ss ES: 


Hence 


A\(s) = min max f,(s;/,s3) = max min f, (sj, 53) 
ssES: sfES, sES; ss ES: 


and s is a saddle point and von Neumann-Morgenstern solution of (J, S, f). 
By Nash (1951), moreover, s © N(o). 


Ad (b). Assume s is a saddle point. We must show that s is good for both 
players. Consider player 1. Since he has only one opponent, P(1,0) = 
A(2,0). A situation 


(s{,5,) € A(2,0)_ if 
Ax (S1, 52) = fa (51,82), WSz © Sp, 
that is, using the constant-sum property, if 
Si (Si. 53) = moat fi 61153). 
A situation, s € A (2,0), then, is good for player 1, if 


f(s) = max = f\(s’) = max min f/f, (s;,53). 
s’€ A(2,0) sES; ssES: 
Since this is true by hypothesis, we see that s is good for player |. By a 
symmetrical argument, s is good for player 2 also. = 


IV 


It is appropriate now to show that commitment equilibria exist for large 
categories of games. In practicality, we will have no difficulty finding such 
equilibria for the games we look at, so the existence theorem will not need 
to be used afterward. For this reason, it is not as strong as it could be. We 
prove existence by first showing that every NE has a commitment pattern 
that yields a commitment equilibrium. 


Lemma 1. (NEs Have Equilibria). Let f be strictly positive. If s isan NE of 
(1, Sf), then there exists a g such that (g, s) is a commitment equilibrium 


of IS. f)*. 
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Proof. Let g be given by: 
For all i: g,(§) = £,(8) if 5; # 5; 


We must show that (g, s) is a commitment equilibrium. Since /(-) is strictly 
positive, it is clear that s is an NE of (J, S, f—g). We must show that (g, s) 
is not beaten. 

Consider any i € /. In (J, S, f—g), player j ¥ i is always better off 
choosing s; than any other strategy no matter what the other players do. 
Hence every element of P(i, g), i’s set of possible points, is of the form (s_,, 
5,). Because s is an NE of (J, S, f), 


Fits) = ji(s.j,5;) forall s,; €S;. 


Hence by the Possible Point Theorem, (g, s) is not beaten. Therefore (g, s) 
is a commitment equilibrium. @ 


Theorem 8. (Existence). Let f be strictly positive and let (I, S, f) be finite 
or satisfy the Glicksberg conditions. Then (I, S, f)* has a commitment 
equilibrium. 


Proof. By Nash (1951) or Glicksberg (1952), (J, S, f) has an NE. Let s 
denote one such NE. By lemma 1, there is a g such that (g,s) is a com- 
mitment equilibrium of QED. @ 


V 


Commitment equilibrium, we mentioned before, lets us study the mecha- 
nism of cooperation. Cooperative behavior is possible only when players 
make promises and threats by selectively reducing their payoff functions. 
Game theory’s pons asinorum, prisoners’ dilemma, illustrates what com- 
mitments can—and cannot—do. 

We repeat the payoff matrix: 


Player 2 


Don’t Confess Confess 


Don’t Confess 
Player | 


Confess 
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Since either player can assure himself of | by confessing, Individual 
Improvement prevents the single confession situations from supporting com- 
mitment equilibria. 

One commitment equilibrium occurs when nobody promises and both 
confess. With no commitments, each player’s possible set consists of the 
situations where: 


He doesn’t confess, the other player confesses, and his payoff is zero. 
Both confess, and his payoff is one. 


Clearly the dual confession situation is good for both, and thus is an equi- 
librium. It makes no sense for a player to make a commitment in this game 
if his partner has not made a commitment; a lonely commitment can result 
only in a long and lonely jail term. 

The only stable cooperative pattern is a dual promise: the commitment 
pattern where each promises not to confess if the other does not, and the 
situation of no confessions is also a commitment equilibrium. To make the 
promises, each player must subtract an amount greater than one from his 
payoff in the situation where he alone confesses. The situations in each 
player’s possible set are then: 


Neither confesses, and his payoff is five. 
Both confess, and his payoff is one. 


Neither confessing, then, is good for both, and the equilibrium. It makes no 
sense for a player not to promise if his partner has already promised: given 
his partner’s promise the NEs are at dual confession, if he makes no promise, 
and at no confessions, if he promises not to confess alone. 


VI 


Now we will show how the concept of commitment equilibrium fits in with 
what we were saying about rationality in the first two chapters. 

First, it should be clear that commitment equilibrium is a type of ration- 
ality. The goodness theorem does all the work for us here. “Possibility” is a 
type of interesting-ness, as we used that term in chapter 2, and “goodness” 
is a type of worthiness. A situation must be rational in this sense for every 
player in order for it to be associated with a commitment equilibrium. 

Much more interesting is the fact that any situation that is an equilibrium 
for any type of rationality is also a commitment equilibrium with some 
commitment pattern. We have already shown this to be the case for von 
Neumann- Morgenstern two-person constant-sum game rationality (theorem 
7, part b) and for Nash rationality (lemma 1). Our claim in chapter 2 that 
for any type of rationality saddle-points are the only equilibria in two- 
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person constant-sum games follows from this relationship and theorem 7, 
part a. 

Why this relationship should hold is also something that can be demon- 
strated through the goodness theorem. Consider any arbitrary type of ration- 
ality —call it R-rationality —that has at least one R-equilibrium, situation s. 
Since s is R-worthy for all i, it must be R-interesting for all 7 a fortiori. 
Thus there must be some collection of interesting sets, one for each player, 
such that s is in the intersection of these sets. Let T, denote the interesting 
set for player i that is in this collection. 

Consider the following commitment pattern: 


€) —7its) if sé) 7, for alli eT 
jel 
=0 otherwise. 


For a situation to be acceptable to some player / it must be in 7,, and fora 
situation to be possible for player 7, it must be acceptable to player 7. Thus 
for a situation to be possible for player 7 it must be in 7;: 


Pine) (oF. formally mew (2) 


We claim that the R-equilibrium s is in P(i, g). Suppose it is not. Then 
there is some player j ~/ for whom s ¢ A(/j, g); that is, there is some §; € S; 
with 


(Cp = SCO) SO ae 6) (3) 


Since s is interesting for all players, g;(s) = 0. Either (5;, s_;) is interesting 
for all players or it is not. If it is not, the left-hand side of (3) equals zero 
and (3) does not hold. Thus if (3) holds, (S;, s_; ) must be interesting for all 
players, and in particular it must be interesting for player /. But then from 
(3), 5 is not worthy for player j and is therefore not an R-equilibrium. 
Since this is a contradiction, s is in P(i, g) for every player 7. 

Therefore since s is maximal for every player in his interesting set and is 
in his possible set, it follows from (2) that s is maximal for every player in 
his possible set. Thus it is good for all players and (g,s5) is a commitment 
equilibrium. This is the relationship we wanted to show. 

Commitment equilibrium, therefore, is the most general “solution con- 
cept” there is, and includes all other definitions of rationality as special 
cases. Studying commitment equilibrium lets us find out whether more 
particular approaches to rationality and particular sets of institutions (com- 
mitment patterns) are viable and capable of producing the situations we 
actually observe as equilibria. It does all this by a “micro-microanalysis” of 
promises and threats, the mechanics of cooperation. 


4 = Time 


... And indeed there will be time 

For the yellow smoke that slides along the street, 
Rubbing its back upon the window-panes; 
There will be time, there will be time 

To prepare a face to meet the faces you meet; 
There will be time to murder and create, 

And time for all the works and days of hands 
That lift and drop a question on your plate; 
Time for you and time for me, 

And time yet for a hundred indecisions 

And for a hundred visions and revisions 

Before the taking of a toast and tea... . 

T. S. ELIOT, “The Love Song of J. Alfred Prufrock” 


Not everything happens simultaneously. Because of this, people know dif- 
ferent things at different points in their lives. This changing of knowledge is 
the game-theoretic function of time. 

For the last two chapters time did not concern us. At the beginning of 
chapter 2, however, we promised that time, ignorance and uncertainty could 
be easily incorporated into the atemporal normal form framework we were 
using. Here we will make good on that promise. Doing so is easy because 
von Neumann-Morgenstern (1944), Kuhn (1953), and Selten (1975) provide 
all the results we need. (Readers familiar with those papers may omit this 
chapter virtually costlessly.) 

In this chapter, then, some players will be able to receive new informa- 
tion information they did not have at the beginning of the game—before 
they have made ali their decisions. Time for us, as for Prufrock, is time for 
indecisions, visions, and revisions; if the passage of time does not mean that 
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a later decision can use some additional piece of information, then it is 
really of no interest to us. Clocks and calendars do not concern us: 


In a minute there is time 
For decisions and revisions which a minute will reverse. 


Games in which time figures explicitly are called extensive games. Follow- 
ing Selten (1975) we can describe any extensive game as a sextuple: 


(Ke UC, ph) 


where the six constituents provide a summary of the rules of the game. 

The first constituent is the game tree K. This is simply a tree with a 
distinguished vertex o, called the origin of K. The sequence of vertices and 
edges that connects o with a vertex x is called the path to x. Vertex y comes 
after vertex x if x is different from y and the path to y contains the path 
to x. An endpoint is a vertex that has no vertices coming after it. A path 
from the origin to an endpoint is called a p/ay. The set of all endpoints is 
denoted by Z, and the set of all vertices that are not endpoints is denoted 
by X. An edge that connects vertex x with a vertex after x is called an 
alternative at x. 

Roughly speaking, the game tree provides a summary of the various ways 
that a game can be played. Every vertex represents some choice a player (or 
Chance) can make in the course of playing the game, with the edges at the 
vertex corresponding to the alternatives of the choice. Every path from the 
origin to an endpoint represents a particular way that the game can be 
played from beginning to end; that is why we called it a play. 

The second constituent of an extensive game is the player partition P = 
(Py), P,.---,P,), which partitions X, the set of vertices of K that are not 
endpoints. Each element P; of P is called player i’s player set; roughly 
speaking, it contains all the vertices where player i is the decision-maker. 
Player 0 represents Chance, or Mother Nature, or the Umpire, or whatever 
it is that decides the things no player in the game decides. A player set may 
be empty. 

The next constituent is the information partition U. For i = 1,...,n a 
subset u of P,; is called information-eligible if u is not empty, if no play 
intersects wu more than once, and if the number of alternatives at every 
vertex in uw is the same. A subset uw € Py is information-eligible if it contains 
exactly one vertex. The information partition U is a refinement of the 
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player partition P into information-eligible subsets u of the player sets. 
These sets u are called information sets. The set of all information sets in 
P, is denoted by U;. 

Roughly speaking, again, all the vertices in an information set uw are 
indistinguishable for the decision-maker. He knows that play has progressed 
to a point where one of the choices is the one he has to make, but he has no 
idea of which one. Perfect information is when every information set is a 
singleton; then every decision-maker knows precisely what has gone on 
before. 

The fourth constituent of an extensive game is the choice partition C. 
For u € U let A, be the set of all alternatives at vertices x © u. A subset c 
of A, is choice-eligible if it contains exactly one alternative at x for every 
vertex x © u. The choice partition C partitions the set of all edges of K into 
choice-eligible subsets c of the A, with u © U. These sets ¢ are called 
choices. The choices c that are subsets of A, are called choices at u, and 
the set of all choices at w is called C,,. If uw © U, and i > 0, then the choices 
are called personal choices (i.e., if Chance is not the decision-maker). A 
vertex x comes after a choice c if one of the edges in c is on the path to x. 

Thus, all the edges in a choice c are indistinguishable to the decision- 
maker, just as all the vertices in an information set u are indistinguishable. 
A plurality of elements in an information set reflects the decision-maker’s 
ignorance of what has gone on; the consequent plurality of elements in his 
choice sets reflects the consequent ignorance of what it is that he is doing. 

A game has perfect recall if every player’s information partition U;, i = 
ei gee n has the following property: if uw and v are both in U, and if one 
vertex » © vcomes after a choice c at u, then every x € v comes after this 
choice. In a game with perfect recall a player who has to make a decision at 
one of his information sets knows which of his other information sets have 
been reached in the previous course of the play and which choices he made 
there. We will consider only games with perfect recall. 

The fifth constituent of an extensive game is the probability assignment 
p that specifies the probabilities of the random choices that we leave to 
Chance or Mother Nature. Precisely, the probability assignment p is a 
function that assigns a probability distribution p, over C, to every u © Up; 
we require that p,(c) be strictly positive for every c © C, (otherwise the 
possibility would not be a possibility at all). 

Finally, the payoff function h assigns a vector h(z) = (/,(z), A(z), 
...,/,(z)) with nonnegative real numbers as components to every endpoint 
z. The vector A(z) is the payoff vector at z and the component /,(z) is 
player i’s payoff at z. 
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II 


People play extensive games by choosing alternatives at whatever informa- 
tion sets present themselves; they play normal form games by choosing 
strategies. These two processes can be reconciled by analyzing decision- 
making in extensive games a bit more deeply. 

The way to do this is to consider von Neumann and Morgenstern’s defi- 
nition of a “strategy.” For each player, a strategy is “a plan which specifies 
what choices he will make in every possible situation, for every possible 
actual information which he may possess at that moment in conformity 
with the pattern of information which the rules of the game provide for him 
for that case” (1944, p. 79). An extensive game strategy, then, provides a 
player with a choice at every one of his information sets. Playing an exten- 
sive game is then a process of choosing strategies, just like a normal form 
game. 

As von Neumann and Morgenstern argue, “Observe that if we require 
each player to start the game with a complete plan of this kind, i1.e., witha 
strategy, we by no means restrict his freedom of action. In particular, we do 
not thereby force him to make decisions on the basis of less information 
than there would be available for him in each practical instance in an actual 
play. This is because the strategy is supposed to specify every particular 
decision only as a function of just that amount of actual information which 
would be available for this purpose in an actual play. The only extra burden 
our assumption puts on the player is the intellectual one to be prepared 
with a rule of behavior for all eventualities—although he is to go through 
one play only. But this is an innocuous assumption within the confines of a 
mathematical analysis.” (ibid.) 

One may imagine a strategy as a complete, detailed instruction book, 
covering all eventualities, that a player could give to a trusted surrogate if 
he was unable to attend an actual play of the game; the surrogate would 
then serve as a perfect substitute for the player himself. All players, in fact, 
could send surrogates like this; there is no need for their actual attendance. 
There is no need, in fact, for the surrogates, either, once every player has 
compiled his instruction book: some central authority could gather all these 
instruction books, painstakingly compare them, construct from them the 
course of the play that would have eventuated if these instruction books 
had been followed, and assign each player the payoff associated with that 
play. One can thus consider the payoffs as functions of the instruction books, 
or strategies, alone, since once the instruction books have been compiled, 
all else follows. 
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Kuhn and Selten show how this argument can be formalized and ex- 
tended to varieties of mixed strategies. 

A local strategy b,, at the information set u € U, is a probability distri- 
bution over the set C, of the choices at wu; it assigns a probability 5,,(c) to 
every choice ¢ at u. A pure local strategy assigns a probability of one to one 
choice at u and zero to the other choices. 

A behavior strategy b, is a function that assigns a local strategy 6,, to 
every u © U,. The set of all of player i’s behavior strategies is denoted by 
B,. The behavior strategy that is formed from 5, by changing the local 
strategy at u from 5,, to Bi is denoted by b,/h,,,. A behavior strategy that 
assigns a pure local strategy to every information set u is called a pure 
strategy. The set of all player i’s pure strategies is denoted by z;. A mixed 
strategy is a probability distribution over 7,,; it assigns a probability to every 
pure strategy. 

Most generally, a behavior strategy mixture m, for player i is a proba- 
bility distribution over B;. The set of all behavior strategy mixtures is de- 
noted by M,. Note that behavior strategies, pure strategies, and mixed 
strategies are all particular kinds of behavior strategy mixtures: behavior 
strategies are behavior strategy mixtures where all the probability is assigned 
to one behavior strategy, pure strategies are behavior strategy mixtures 
where all the probability is assigned to one behavior strategy that is pure, 
and mixed strategies are behavior strategy mixtures that assign positive 
probability only to pure strategies. 

A situation m = (m,, m),..., m,,) in behavior strategy mixtures is an 
n-tuple of behavior strategy mixtures. Given such a situation m, we can 
compute a realization probability p(x,m) for every vertex x © K; this is the 
probability that the play will reach vertex x if the players use the behavior 
strategy mixtures of m. From the realization probabilities for the end- 
points of K, we can compute an expected payoff vector H(m) = (H,(m), 
H,(m),...,H,,(m)) for every behavior strategy mixture situation 7: 


H(m) = > p(z,m) h(z). 
2Ez 
(Obviously this definition applies to situations in pure, mixed, and behavior 
strategies as well.) 

Thus we have shown how an extensive game can be considered a normal- 
form game (/, M, H). 

There is, moreover, an even simpler normal-form game we can use: 
(J, B, H). This is because Kuhn proved that one need consider only be- 
havior strategies; anything that can be done with behavior strategy mixtures 
in games with perfect recall can also be done with behavior strategies. 
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To be precise, we say that two of player i’s behavior strategy mixtures // 
and m/” are realization equivalent if they make the realization probabilities 
of every vertex identical no matter what the other players do: 


p(x, (m_;, mj) = p(x, (m_;, m;")) 


for all x € Kand all m_; © X;z, Mj. Selten’s statement of Kuhn’s theorem is 
that “in every extensive game with perfect recall a realization equivalent 
behavior strategy b; can be found for every behavior strategy mixture m, of 
a personal player” (1975, p. 30). Thus we can restrict our attention to be- 
havior strategies. 


Ill 


Since we can describe every extensive game with perfect recall as a normal 
form game (J, B, H), all of our results in chapters 2 and 3 about rationality 
for normal form games carry over without any problems. Strategies are 
somewhat more complicated objects than we may have imagined in those 
two chapters, and the associated optimization problems are correspondingly 
more tedious, but these difficulties are, in principle at least, entirely incon- 
sequential. In particular, we know that because of the generality of com- 
mitment equilibrium, we can simulate any form of rationality we want to 
by making appropriate subtractions from payoff functions and then finding 
Nash equilibria. All we need to be concerned about, then, are Nash equi- 
libria, and since the definition and basic results for NEs carry over there 
appears to be no cause for concern. 

There is, however, one problem with NEs in extensive games. It centers 
on unreached information sets. Suppose b is an NE and that with b the 
realization probability of every vertex in some information set wu of player i 
is zero. Information set u “never happens.” Then what player / plans to do 
at information set u cannot affect his (or any other player’s) payoff. Player 
i can change his local strategy at uw to anything at all, no matter how silly, 
without disturbing the NE. Clearly, such frivolity at irrelevant parts of the 
game should not affect the NEs, and if only one player is acting frivolously 
it will not; but when several players do so together, joint frivolity in never- 
never land can impinge on the real world and create NEs that owe their 
existence to frivolity. Selten calls such NEs imperfect; he calls other NEs 
perfect. 

Before being more precise about these matters, we will be more concrete 
and present Selten’s numerical example. This is the extensive game pictured 
in figure 1. Player sets are identical with information sets (each player has 
only one information set), and are indicated by dashed lines. Payoff vectors 
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Figure 1 


are indicated by column vectors above the corresponding endpoints. In this 
game player | moves first and chooses either left or right. If player | chooses 
left, player 3 moves next and chooses either left or right and the game ends. 
If player 1 chooses right, player 2 moves next and chooses either left or 
right. If player 2 chooses right, the game ends. If player 2 chooses left, 
player 3 gets to complete the game by choosing either left or right. When 
player 3 gets to move, however, he does not know whether or not player 2’s 
move has intervened between his move and player I’s. 

Since every player has only one information set and only two choices 
available at that information set, every player’s behavior strategy can be 
described completely by the probability with which he selects right. A be- 
havior strategy situation is a triplet (p,;, P2, P;). 

This game has two types of NEs: 


Typet: p, =l,p, =1,0Sp,;=1/4 
Type 2: p, =0,1/3 =p, =1, p; =1. 


Type 2 NEs are imperfect. Player 2’s information set is never reached, 
and so what he does does not affect his payoff. His local strategy there is 
frivolous in this sense: Suppose that for some reason player 2’s information 
set is reached. Then since at type 2 NEs player 3 is certainly choosing right, 
the outcome of the game will be at z, if player 2 chooses left and at z, if he 
chooses right. Since player 2 receives 4 at z, and | at z,, it would be 
entirely irrational under these circumstances for him to do anything but 
choose left with certainty—but at type 2 equilibria he is choosing right 
with a probability of at least one-third. 
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Nor is such frivolity inconsequential, even if it occurs in make-believe. 
Player 2’s frivolity makes it rational for player | to choose left rather than 
right, and this in turn makes it rational for player 3 to choose right instead 
of left. Type 1 NEs end up (with certainty) at z; with payoff vector (1, 1, 1); 
type 2 NEs end up (with certainty) at z, with payoff vector (3, 2, 2). 

What Selten uses to formalize the difference between frivolous and non- 
frivolous behavior strategies on which the definition of perfect equilibrium 
must rest is the notion of slight mistakes. A perturbed game T is a pair 
(T, 7) where T is a finite extensive game with perfect recall, and 7 is a 
function that assigns a positive probability n. to every personal choice ¢ in 
T such that 

Dn <1 

caltu 
and requires every local strategy at wu to satisfy b,,(c) 2 7. for all c. In 
a perturbed game, the behavior strategies available to the players are re- 
stricted — by the irreducible possibility of a slight mistake, so to speak —to 
those where every choice is possible: pure strategies are not available in I. 
If B denotes the set of behavioral strategies available in I, then P' can be 
represented as (J, B, H), and there is no problem defining NEs in r. 

Every information set in U has some positive probability of being reached 
in I’, no matter what behavior strategy situation applies. Thus at an NE in 
l there is no room for frivolous behavior, because there is no never-never 
land. This is why Selten uses perturbed games to define perfect equilibria. 

Specifically, consider a sequence ["', T'’,..., Peer oe perturbed games 

* = (LT, n‘) of I. If for every personal choice c, the minimum probability 
ni converges to 0 for k — ©, the sequence is called a test sequence. A 
behavior strategy situation 5 is called a /imit equilibrium of a test sequence 
Rep ape if for every k an NE 5* can be found such that for k — 
the sequence of the 5* converges to b. A behavior strategy situation b* is a 
pores equilibrium for I if there is at least one test sequence, ['', P*,..., 
I... for which b* is a limit equilibrium. Selten proves that every perfect 
eannianin of Tis an NE of I’ (p. 37, lemma 3), and that every finite game 
with perfect recall has at least one perfect equilibrium (p. 48, theorem 6). 
Most importantly, he also shows that at a perfect equilibrium every player 
plans to behave Nash-rationally from every one of his information sets on 
to the end of the game, even if that information set will never be reached 
(pp. 45-46, theorem 3). 

We will, therefore, for the remainder of the book, be concerned for the 
most part with perfect NEs, their continuous game analogues, and the no- 
tion of acceptability implied by perfection. Players should act rationally no 
matter what information set they find themselves at. For continuous games, 
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moreover, and for many finite ones as well, perfect equilibria are often 
easier to compute than imperfect ones. Computational ease and theoretical 
correctness are not always consonant with each other, but when they are 
the effect is compelling. 


IV 


Finally, let us note that the perfectness concept simplifies our definition of 
commitment equilibrium: A commitment equilibrium is a perfect equilib- 
rium of a two-stage game in which players make commitments at the first 
stage and play the modified game at the second. 


5 = Expectations 


Blessed is he who expects nothing, for he shall never be disappointed. 


ALEXANDER POPE 


Modelling expectations is an accepted part of macroeconomics. What people 
do now depends on what they think will happen in the future, and what 
they think will happen in the future depends in some way on what happened 
in the past. Thus, it is commonly believed that it is impossible to do macro- 
economics without some probability theory mechanism that links people’s 
subjective views about the future to objective events in the past. Many of 
the major macroeconomic controversies of the last fifteen years have cen- 
tered on different mechanisms for doing so. 

In this chapter we will argue that the search for such a mechanism is not 
consonant with the tradition of rationality that defines economics. There 
are, to be sure, times when these mechanisms are not inappropriate: games 
against nature. But games with other players differ fundamentally from 
games against nature, and it is a misleading analogy that leads economists 
to seek some parallel process that allows external events to imprint proba- 
bilities of other players’ actions onto players’ psyches. Rationality is not a 
method for attaching numbers to conjectures. 

Our arguments in this chapter may appear somewhat diffuse because the 
views we are arguing against have rarely been stated explicitly. Indeed | 
have been unable to find an explicit argument for the use of expectations 
anywhere in the literature. This lack of an explicit argument is even more 
surprising in light of the substantial volume of writing that questions the 
use of expectations, probability theory, and analogies with games against 
nature. This literature is surveyed in the first section of this chapter. 

The next section analyzes games against nature, the mechanisms pro- 
posed for linking external events to probability assessments in these games, 
and the justifications for these mechanisms. The third section asks whether 
these mechanisms and their justifications can be extended to games with 
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other players and concludes that they cannot. The fourth section shows that 
even if some justifiable method were found to link external events to in- 
ternal probabilities, it could not be considered rational if it did not coincide 
with commitment equilibrium —thus there is no advantage to searching for 
better methods. The fifth section is about “temporary equilibrium.” 

(Appendix C, on Newcomb’s problem, may also be read in conjunction 
with this chapter. There we show that this philosophical problem arises 
from a mistaken application of games-against-nature methods to a game 
with other players.) 


As with most other fundamental matters in this book, the best statement of 
our position that the problems of rationality in many-person games cannot 
be “obviated . . . by a mere recourse to the devices of the theory of proba- 
bility” is due to von Neumann and Morgenstern: 


Every participant can determine the variables which describe his own 
actions but not those of the others. Nevertheless those “alien” variables 
cannot, from his point of view, be described by statistical assump- 
tions. This is because the others are guided, just as he himself, by 
rational principles—whatever that may mean—and no modus pro- 
cedendi can be correct which does not attempt to understand those 
principles and the interactions of the conflicting interests of all par- 


ticipants. (1944, p. II) 


This unwillingness to use statistical techniques for games was not original 
with von Neumann and Morgenstern, however. As early as 1908 Poincaré 
denied that the laws of chance applied to the “moral sciences,” though he 
was by no means as clear as von Neumann and Morgenstern: 


We are tempted to attribute facts of this nature to chance because their 
causes are obscure, but this is not true chance. The causes are unknown 
to us, itis true, and they are even complex; but they are not sufficiently 
complex, and we have seen that this is the distinguishing mark of “too 
simple” causes. When men are brought together, they no longer decide 
by chance and independently of each other, but react upon one another. 
Many causes come into action, they trouble the men and draw them this 
way and that, but there is one thing they cannot destroy, the habits they 
have of Panurge’s sheep.' (1908, p. 88) 


1. In Rabelais’ Gargantua et Pantagruel, Panurge destroys the flock of a shepherd who has 
angered him. He does this by purchasing the lead sheep and throwing it into the ocean. The 
other sheep follow their leader. 
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Borel made a similar point, somewhat more analytically, in his review of 
Keynes’s Treatise on Probability: 


However, there is an important enough case in which the numerical 
evaluation of probabilities presents some special difficulties, but it does 
not seem that Mr. Keynes has given to this case the special impor- 
tance that it appears to me to have, although one could try to relate 
to it certain examples that he gives. This case is the one in which the 
event of which the realization is in question is not actually determined 
and can depend on judgments for which one searches to define the 
probabilities . . . 

Take a simple example. Consider the question of betting on the 
result of an election, a practice engaged in currently in certain coun- 
tries. It is clear that it can produce multiple reaction; on the one hand, 
the partisans of each candidate look to augment his chances by openly 
betting great sums on him; on the other hand certain voters can be 
influenced by the desire to vote for the candidate who, according to 
their judgment, will be elected. Certain bettors who are at the same 
time voters can have their vote influenced by the desire for gain. A new 
candidate can surge forward if the bets are large in favor of this com- 
bination, etc. Under these conditions, can one admit that the proba- 
bility of judgment carried by a bet has a determinate numerical value? 


(1924, p. 58) 


The division between games against nature and “games of strategy” 
(games with other players) in standard works like Luce and Raiffa’s Games 
and Decisions (1957) and Blackwell and Girshick’s Theory of Games and 
Statistical Decisions (1954) also supports the von Neumann-Morgenstern 
distinction, a/beit implicitly. 

Dréze is alone among modern writers, to my knowledge, in explicitly 
denying this division, but his denial does not go so far as to support the use 
of objective events to determine subjective probabilities. Dréze (1971; cf. 
1972, 1960, 1961) holds that the theory he has developed for games against 
nature generalizes easily to include games of strategy, and hence games 
of strategy are merely a special type of games against nature, or, more 
specifically —and the distinction is key—that the normative theory of in- 
dividual decision-making in games of strategy is merely a special case of the 
normative theory of decision-making in games against nature: “By succes- 
sive redefinition of the strategies of a player’s opponents, it is always possible 
to formalize the decision-problem facing a player in a game of strategy as a 
game against nature, where the states of nature are described with reference 
to the opponent’s strategies” (1972, p. 16). His method is essentially to 
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define probability measures on situations conditionally upon the choice of a 
strategy by the decision-maker and to use the principle of maximizing ex- 
pected utility (“moral expectation”) to govern choices among strategies. 

Dréze’s analysis is compatible with ours because all he is talking about is 
individual rationality. His “redefinition of opponent's strategies” is the same 
thing as our interesting sets, and his maximizing of expected utility is the 
same principle we follow in deriving worthy sets from interesting sets, and 
thus his view of rationality is the same as ours. It is our position, too, that 
the principles of individual rationality are the same in both games against 
nature and games of strategy. 

Dréze also shares our view that rationality, as we agree on it, is funda- 
mental, and the question of what sets are interesting is secondary, or entirely 
extra-rational: 


In this vein, we might also speak about two levels of “rationality”: the 
most fundamental level, at which rules of consistency are specified; 
these rules result in the principle of moral expectation; at a less funda- 
mental level, the “prudential” principle of minimaxing, or the principle 
of insufficient reason, prove helpful in applying the rule of moral ex- 
pectation to specific contexts; their claims to “rationality” are however 
less convincing than those of the consistency rules of games against 
nature. (Ibid.) 


Thus Dréze does not see the linking of external events to probabilities as 
the role of rationality. The only difference, then, between this book and 
Dréze’s argument is the additional emphasis we place on equilibrium. But 
this difference is entirely explained by the divergent goals of our inquiries. 
Dréze is seeking a normative theory. Equilibrium, we stressed, is an em- 
pirical requirement. That it does not concern him is not surprising. 

Nor has less mathematical economics been any more eager to derive 
probabilities from external events. Writers such as Knight (1921) and 
Shackle (1949) have denied the usefulness of numerical probabilities, though 
not the importance of expectation, in nontrivial economic decision-making, 
and this position has come to be recognized as a major tenet of the “Aus- 
trian” school. Probably the best statement of this position, though, is that 
of Keynes: 


By “uncertain knowledge,” let me explain, | do not mean merely to 
distinguish what is known from what is only probable. The game of 
roulette is not subject, in this sense, to uncertainty; nor is the prospect 
of a Victory bond being drawn. Or, again, the expectation of life is 
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only slightly uncertain. Even the weather is only moderately uncertain. 
The sense in which I am using the term is that in which the prospect 
of a European war is uncertain, or the price of copper and the rate of 
interest twenty years hence, or the obsolescence of a new invention, 
or the position of private wealth-owners in the social system in 1970. 
About these matters there is no scientific basis on which to form any 
calculable probability whatever. We simply do not know. (1937, pp. 


213-214) 


Note that the events cited as uncertain depend on the actions of conscious 
mutually interdependent agents—players—while the less uncertain events 
do not. 

Keynes, having written one of the twentieth century’s major philosophical 
discussions of probability, was acutely conscious of its role, and portrayed 
his views on probability as a major and underlying difference between clas- 
sical economists and himself: “The orthodox theory assumes that we have a 
knowledge of the future of a kind quite different from that which we actually 
possess. This false rationalization follows the lines of the Benthamite cal- 
culus. The hypothesis of a calculable future leads to a wrong interpretation 
of the principles of behavior which the need for action compels us to adopt, 
and to an underestimation of the concealed factors of utter doubt, precari- 
ousness, hope, and fear” (ibid., p. 222). 

Thus we see that numerical modelling of expectations in games of strategy 
has been opposed by quite a long and eminent list of writers; there is nothing 
novel about our position. 


II 


Can external events ever be used to generate probabilities to guide people’s 
actions? The consensus on this question is yes, and an examination of the 
circumstances that give rise to this answer—games against nature —can 
show why external events do not always generate probabilities. 

Consider a game in which the only two players are Robinson Crusoe 
and Mother Nature. To be even more specific, suppose Crusoe is deciding 
whether to climb a tall palm tree, the top of which he cannot see. If Mother 
Nature has put a coconut at the top of the tree, Crusoe’s climb will be 
worthwhile; if she has not, it will not be. We may even suppose that Crusoe 
has a payoff function that assigns utilities to the four situations that can 
occur: 
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Mother Nature’s Strategy 
Coconut No Coconut 


Climb 


Crusoe’s Strategy 


Don’t Climb 
5 5 


To find out what the equilibria are in this game, and thus what predic- 
tions we can make about how it will be played, we need to know Mother 
Nature’s payoff function. There are various views of what Mother Nature’s 
payoff function is—Murphy’s Law and the Sermon on the Mount, for in- 
stance, provide contrasting positions—but the view that is predominant in 
probability-using cultures is that Mother Nature is, at the very least, indif- 
ferent about what strategy Crusoe chooses. “Now if that is how God clothes 
the grass in the field which is there today and thrown into the furnace 
tomorrow, will He not much more look after you, you men of little faith?” is 
the epigraph for no treatise on decision theory, and it is difficult to imagine 
how Western science could have developed in a society that took this Gospel 
seriously. 

We will be secular, then, and insist that Mother Nature’s payoff be the 
same in all situations where her strategy is the same. We also restrict our 
attention to commitments that have this same “indifference-to-Crusoe” 
property. These two secularity assumptions are the core of modern decision 
theory, and the reason why games against nature are distinctive. Newcomb’s 
problem, which we discuss in Appendix C, troubles philosophers because it 
presents as something that looks like a game against nature a circumstance 
where secularity is uncertain. 

To simplify discourse further we will set Mother Nature’s payoff equal to 
one at all situations. This will greatly simplify the analysis, but it will not 
change the results: the secularity assumptions do the real work. A strategy 
for Mother Nature will be a probability p for putting coconuts in the tree, 
and a strategy for Crusoe will be a probability g for climbing the tree. 
Mother Nature’s and Crusoe’s payoff functions are thus: 


tp. q) = | 
J (p,.4) = 0 ge 7-S() —@), 


respectively. 
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First, let us observe that in a certain sense commitments by Crusoe do 
not really matter. Suppose commitment pattern g = (g™, g‘) prevails. 
Whatever g is, Mother Nature’s good set will be identical to her possible set, 
since all situations have the same payoff to her, and her possible set will be 
identical to Crusoe’s acceptable set, since Crusoe is the only other player. 
Thus Mother Nature’s good set will be identical to Crusoe’s acceptable set, 
which will depend on his commitment, but not Mother Nature’s. On the 
other hand, Crusoe’s good set is the situations that maximize his payoff in 
his possible set, which is identical to Mother Nature’s acceptable set. Mother 
Nature’s acceptable set depends on her commitment, but not on Crusoe’s. 
Thus for (g,(p,q)) to be an equilibrium, (p,q) must maximize Crusoe’s 
payoff in Mother Nature’s acceptable set, and be in Crusoe’s acceptable set: 


WeOP,e) = | (P, 4) for all (6, q) in A(M, g) (1) 
and 
mapa) =(f — 2 )(p.q) tor all gq © (0,1). (2) 


Now suppose that ((g¢™, ¢°), (p, q)) is an equilibrium but that ((g™, 0), 
(p, q)) is not. Since Mother Nature’s acceptable set depends on her com- 
mitment alone, A(M, (g“,0)) = A(M, (g™, g‘)) and 


f(D. =f (Bb. for all (6,gG) in A(M,(g™0)) (3) 


since ((g™, g‘), (p. q)) was by hypothesis an equilibrium. Then it must be 
the case that (2) does not hold; i.e., that there is some g with 


mPa) — fF Cp, @). (4) 


Comparing (3) and (4), we see that it must be the case that (p,q) € 
A(M, ( een 0)), so that there must be some / such that 


oe 2 \(p,g) >(f-& (pg) (5) 
From secularity, though 

(f" — 9") (b.9) =(f" — 8") (0.9) 
and 

(f= 8")\(p.4) = (f" — 2"). @)- 
Combining these with (5), we obtain 


fee 2 1G) H2)G@) 
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whence it follows that (p,q) is not in A(M,(g™, g°)) and therefore not an 
equilibrium. Since this is a contradiction, we must conclude that our ori- 
ginal supposition was false and its negation true: 


If ((g™, g°), (p, q)) is an equilibrium, then so is ((g”, 0), (p, q)). (6) 


Proposition (6) means that in a secular world, shaking one’s fist at, 
negotiating with, and praying to Mother Nature are all equally ineffective. 
Crusoe’s threats and promises cannot in the least bit budge Mother Nature, 
because she does not care what he does. 

Proposition (6) also means that in a secular world we can confine our 
attention to commitment patterns with g° = 0. Since it is easy to show that 
if ((g¢™, 0), (p, q)) is an equilibrium and (p, g) € A(C, (g™, g‘)) then 
((g¢™, g°), (p, q)) is also an equilibrium, all equilibria are simple variants of 
equilibria with g° = 0. Finding equilibria when g° = 0 is particularly un- 
demanding because of the following result: 


((g™, 0), (p,q)) is an equilibrium iff (1). (7) 


Necessity, of course, is merely a restatement of (1). To see why (7) should 
hold in the other direction, note that secularity implies that if (p,q) © 
A(M, g™), then (p, @) € A(M, g™) for all G € (0, 1). Thus (1) implies 


F(P.Q) =f (p.G) for all G € (0, 1) 


which is precisely (2) for g° =0, and (1) and (2) are sufficient for ((g™, 0), 
(p, q)) to be an equilibrium. 

Thus (6) and (7) tell us that equilibria can be found by solving (1). This is 
trivial, although a little notation is needed. Assume A(M, g) is always 
closed and let p*(g™) denote the greatest p such that there is some g with 
(p.q) © A(M, g). (Secularity means that (p*, g) © A(M, g) for all g.) 
Then the equilibrium situations are: 


for g™ with p*(g”) >.5,(p*(g™), I) 
for g™” with p*(g”) =.5,(.5,q) where q €(0, 1) 
for g” with p*(g”)<.5,(p,0) where (p, 0) € A(M, g). 


Now consider commitments by Mother Nature of the form 
(pq) =f" (pq) ifp¥B 
=0 if p = p. 


We call such commitments canonical. Canonical commitments satisfy secu- 
larity. If p*(g™”) = .5, then the canonical commitment with p = p*(g™) has 
the same equilibrium situations as g™ does. If p*(g™) < .5, then the equi- 
librium situation with the canonical commitment pattern with p =p*(e-) 
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is an equilibrium situation with g™, Crusoe’s strategy is the same at the 
canonical commitment pattern equilibrium situation as at all the gequi- 
librium situations, and both players’ payoffs are the same at the canonical 
commitment pattern equilibrium situation as they are at the g*-equilibrium 
situations. Thus to predict Crusoe’s actions and players’ payoffs (and to 
advise Crusoe) all we need to consider are canonical commitments by 
Mother Nature. Economists in a secular world may safely presume that 
Mother Nature is making a canonical commitment, and Crusoe a null one. 

This information, however, does neither us nor Crusoe much good. There 
is an equilibrium for any canonical commitment whatsoever by Mother 
Nature. Because of Mother Nature’s vast indifference, the hypothesis that 
the players are rational does not very severely restrict the situations that 
might be observed; in particular, it does not restrict at all the behavior that 
might be observed of Mother Nature. On the other hand, if we know 
Mother Nature’s commitment, rationality permits us to say quite a bit— 
everything, in fact, that is of interest. This is why game theorists generally 
analyze games as if they knew Mother Nature’s commitment (and why the 
fifth constituent of an extensive game in chapter four was Mother Nature’s 
mixed strategy). The problem is that rationality tells us nothing about 
Mother Nature’s commitment. 

Economists qua students of rationality therefore have nothing to say 
about this game or other, more complicated games against nature. Studying 
rationality, though, is not the only source of knowledge, and so, rather than 
say nothing at all about these games, economists have posited various extra- 
rational processes in Crusoe’s mind to allow them to use events external to 
the game to predict his behavior in it. 

The external events that these processes rely on are previous plays of 
games “similar” to the game under study, and the basic postulate under 
which these processes work is that Crusoe acts as if Mother Nature’s com- 
mitment in “similar” games will be “similar” to her commitment in the 
game under study. If most other palm trees have coconuts at the top, Crusoe 
will believe that this one will too, and climb it. This type of postulate is in- 
tuitively appealing because there is no reason for us as observers or Crusoe 
as a player to believe that Mother Nature is making a commitment other 
than the one she made in similar games, since no commitment is better 
than any other for her, and Crusoe’s commitments make no difference to 
her whatsoever. 

The computational task of these processes, then, is to tease out of the 
historical record of past “similar” plays what Mother Nature’s commitment 
was then and what it will be in the game under study. How to do it is 
difficult and controversial. The word “similar” is the crux of the problem. 
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One can never step in the same river twice, and no game is ever the same as 
one that was played before. Just how simple-minded does Crusoe believe 
Mother Nature is? Does Mother Nature use the same commitment only for 
palm trees at this time of year on this side of the island, or does she use the 
same commitment for all tall objects? Even if Crusoe does not believe that 
Mother Nature uses exactly the same commitment for palm trees on both 
sides of the island, is there some way for him to use his information on 
what she did on the other side of the island? Is there some way that Crusoe 
can use his information that King Kong did not find a coconut at the top of 
the Empire State Building? Different schools of statistical theory and epis- 
temology give different answers about what Crusoe should believe, while 
different schools of expectationist economics give different answers about 
what Crusoe does believe (or, more precisely, what it is that Crusoe acts as 
if he believed). Such controversies are beyond rationality and unlikely ever 
to be resolved. 


Ill 


Thus we see that external events can be used to generate probabilities only 
when secularity holds. But secularity holds only in a particularly barren 
class of games, about which rationality says very little. These methods, 
then, are in a sense techniques of desperation, and using them in more 
fertile games is like irrigating tropical rain forests in imitation of Arizona’s 
farming methods, or clothing rich children in hand-me-down’s from poor 
relations. 

The reasons why generating probabilities from external events had intui- 
tive appeal for games against nature do not carry over into nonsecular 
games of strategy. Suppose that it is Friday, not Mother Nature, who puts 
coconuts in trees, and that Friday cares about whether or not Crusoe climbs 
the tree. We cannot postulate secularity of Friday. Then canonical commit- 
ments have no generality; nor can we act as if Crusoe was making a null 
commitment. 

Even if we should go so far as to allow that Friday is making a canonical 
commitment, the two reasons for the intuitive appeal of using external 
events still vanish. For what commitments Friday made in similar games 
depended on what commitments Crusoe made, and it is because Crusoe is 
thinking about what his commitment will be that he is pondering what 
Friday's is; thus he can seriously suspect that Friday’s commitment might 
also change from what it was in those games. 

The problem of defining what games are similar, moreover, difficult as it 
was with games against nature, becomes almost insuperable in games of 
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strategy. Solving it, too, becomes more important: because of secularity 
no answer to this problem could force Mother Nature to act irrationally 
(basically because Mother Nature cannot act irrationally) but wrong answers 
can force Friday into irrationality. In deciding what games of strategy (if 
any) are similar, Crusoe must take into account Friday’s learning more 
about Crusoe’s behavior (something that matters to him but not to Mother 
Nature) every time the game is played and thus having different information 
every time. He must also consider Friday’s thinking about Crusoe’s thought 
on Friday’s learning in the previous games, and so on in infinite regress. 
Perhaps the only way to resolve this matter is to define similar games as 
those with isomorphic commitment equilibria. But if we do so we are ana- 
lyzing games in terms of their internal structure, not external events. 

Nor is the problem any easier if Crusoe is not a frequentist. No matter 
what his philosophy about probability is, he still cannot attribute secularity 
to Friday and so he cannot appeal to external events of whatever kind 
to induce probabilities. An exception would be if Crusoe’s philosophy of 
probability were a necessarism that derived probabilities from the commit- 
ment equilibria, but such necessarism would not use external events; it 
would represent the harmless rhetorical use of the work “expectations” that 
we described in chapter 1. 


IV 


Indeed, there is no way of analyzing games with rational players except in 
terms of commitment equilibria. We first made this point at the end of 
chapter 3 and are repeating it now only for emphasis. Whatever method we 
wish to use to arrive at probabilities, it will lead us astray unless it leads us 
to commitment equilibria. 

For suppose that Crusoe believed that Friday was making a canonical 
commitment to put a coconut on top of the tree with probability 6. Perhaps 
he considered only a few nearby trees similar, in which case he would be 
said to have “adaptive expectations,” or perhaps he used the best system of 
regression equations economists could come up with to explain his past 
failures and successes in finding coconuts (or fruits) on top of trees (or tall 
things), in which case he might be said to have “rational expectations.” 


2. These are perhaps not what proponents would see as rational expectations in the strict 
sense, but only an empirically implementable approximation to it. In some strict senses, 
rational expectations becomes the necessarist position in which the use of the word “expecta- 
tions” is only a harmless rhetorical device. If rational expectations is understood in this sense, 
the question we are discussing is whether the theory is well served by its empirical imple- 
mentation. 


62 GENERAL 


Or maybe he might have used some other events in some nonfrequentist 
fashion. The particular mechanism is immaterial. 

His good set, then, is all the situations (), q) that maximize his utility 
given that there is a probability p that a coconut is in the tree. It is exactly 
the same as his worthy set if his interesting set is all situations with p = p: 
whether or not there will be an equilibrium depends on whether Friday will 
in fact set p = p: whether Friday’s payoff function and Crusoe’s commit- 
ment are such there is some situation (/, q) in both good sets. (If Crusoe’s 
commitment is also canonical, then a situation will be associated with a 
commitment equilibrium if and only if it is a Nash equilibrium.) If there is 
no equilibrium with p = p and Crusoe’s commitment, then rationality will 
prevent Friday from choosing p = p. 

Friday’s actions depend on the structure of the game, not on his past 
action. 


Vv 


What, then, can account for the popularity of expectations derived from 
past external events in economic modelling? Let us consider the type of 
games and the manner in which expectations are most commonly used. 

These are extensive games in which something called a “temporary equi- 
librium” is sought. It works like this: the information sets of the game are 
partitioned into two sets, the “present” and the “future.” The present in- 
cludes the origin, and no vertex in any information set in the present comes 
after any vertex in any information set in the future. Players’ interesting 
sets of behavioral strategy situations are determined by their expectations, 
and their worthy sets by the usual maximizations. Ordinary equilibria, if 
they exist, would be behavioral strategy situations that are worthy for all 
players, but temporary equilibria are sets of behavioral strategy situations 
that must meet two less stringent criteria: these sets must include at least 
one behavioral strategy situation that is worthy for each player and all be- 
havioral strategy situations in the set must have the same local strategies at 
all information sets in the present. 

All equilibria are temporary equilibria, then, but the converse is not true. 
Expectations can create interesting sets that yield temporary equilibria that 
are divergent behavioral strategy situations. Consider the two-person game 
with the payoff bi-matrix: 
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Player 2 





Player | 








Let player | move first, but let player 2 be ignorant of player I’s move. One 
temporary equilibrium of this game can be arrived at by considering player 
I’s information set the present and player 2’s information set the future. Let 
player 1’s expectation be that player 2 will choose R and player 2’s, that 
player | will choose L. Given this partition and these expectations, the 
temporary equilibrium will be the set {LL, LR}. But neither of the situa- 
tions could ever be in an equilibrium. The situation LL could never be an 
equilibrium because it is not individually improving for player | (he can 
assure himself of 4 by choosing R). The situation LR could never be in an 
equilibrium because it is not individually improving for player 2 (he can 
assure himself of 5 by choosing L). 

The search for temporary equilibria is thus not fully within the tradition 
of rationality. This is not to say that temporary equilibria and the extra- 
rational expectations processes associated with them are not worth studying 
or that no phenomena will ever be found that rationality cannot explain and 
temporary equilibria can. All that it means is that there is a presumption for 
exhausting the possibilities of rationality first. If there is no way—or even 
no reasonably simple way—of describing the phenomena we are interested 
in as equilibria, then by all means we should consider them as temporary 
equilibria. But if the phenomena can be described as equilibria, there is no 
reason to settle for a temporary equilibrium description. 

So we turn now to seeing how well economic phenomena can be de- 
scribed as commitment equilibria. 
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PART TWO ® SPECIFIC 





6 = Small Simple Economies 


Our little systems have their day; 
They have their day and cease to be... 


ALFRED LORD TENNYSON, /n Memoriam 


Can we maintain that people act rationally? We saw in chapter 3 that it did 
not involve any contradiction to assert that people acted rationally; this was 
because commitment equilibria existed in most games. But the fact that we 
can assert something without contradicting ourselves does not mean it is 
true. The question we must now consider is whether there are commitment 
equilibria that resemble the occurrences we observe in the world. 

To do this, we must consider the specific games we are interested in— 
those that resemble actual economies. Our method for these games will be 
to see whether they have commitment equilibria associated with any mem- 
bers of various families of commitment patterns. If they do, and if these 
equilibria resemble things that happen in actuality, then we will be happy — 
both with rationality in general, and with the family of commitment pat- 
terns in particular. If either count fails, we will continue our search for 
other families of commitment patterns. One might wish to identify “families 
of commitment patterns” with “institutions”; then the search for usable 
families of commitment patterns becomes a search for institutions that are 
both logically coherent (because they are associated with commitment equi- 
libria) and empirically satisfying (because their equilibria are what happens). 

That we need axioms beyond simple rationality before we can make 
testable statements should not be surprising; nor does it indicate any weak- 
ness in the concept of commitment equilibrium. Most scientific theories 
require many, many axioms before they can generate testable statements. 
But how does postulating a family of commitment patterns differ from pos- 
tulating a type of expectations? Both steps, to be sure, go beyond rationality, 
but working with commitment patterns does so in a way that is sure not 
to contradict rationality; we have seen that with expectations—unless we 
treat them as a rhetorical device only —there is no such guarantee. All com- 
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mitment pattern statements can be paraphrased in expectation-language, 
but only noncontradictory expectation statements can be paraphrased in 
commitment-language. There is simply no need for expectation-language. 
(Expectation-language also carries with it two misleading connotations 
about the link between rationality and predictions: the first is that the prob- 
lem would not exist in atemporal economies, and the second is that the 
necessary link is private and psychological, not social and institutional.) 

A system where we did not have to postulate families of commitment 
patterns would of course be more elegant, simpler, and more desirable. 
Perhaps there is some way of assigning commitment pattern families to 
games flawlessly, or with a high degree of reliability. Surely such a system is 
worth searching for, but if it exists | do not know what it is. 

With this chapter, then, we have finally reached the stage where we can 
talk about subjects vaguely resembling economics. We start with the sim- 
plest of subjects—atemporal economies with only a few goods and a few 
agents. These economies are too simple, in fact, to have any empirical 
content, but they are building blocks and mental training grounds. For all 
their simplicity, though, they allow us to see a surprisingly large number of 
things: how Walrasian competitive equilibrium is a special type of com- 
mitment equilibrium, how money acts as a medium of exchange, why trust 
alone is inadequate in a monetary economy, and even a little bit about how 
the Brehon code, the legal system of preconquest Ireland, worked. Compli- 
cations and more serious attempts to approximate reality follow in sub- 
sequent chapters. 

One terminological note: from now on, when we say “equilibrium” with- 
out a modifier, we will mean “commitment equilibrium.” This convention 
will shorten the text. 


I 


Let us begin with an economy with two players (1 and 2, as usual), each of 
whom is endowed with a single unit of different indivisible good. Player | 
prefers player 2’s good to the one he is endowed with, and similarly player 2 
prefers player |’s good to his own. Each, however, prefers his own good to 
nothing at all. For the sake of definiteness, let us say that each values his 
own good at | and the other’s good at 5. Assume also that utility is simply 
additive: each player values having both goods at 6. 

Each player controls his own endowment, and that only. Thus each has 
only two strategies available to him: he can keep his good (and consume 
it), or he can give it to the other player. From this discussion we can con- 
struct a payoff matrix: 
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Player 2 


Give Keep 


Give 
Player | 


Keep 








Notice that this bi-matrix is identical to the prisoners’ dilemma bi-matrix in 
chapter 2 (except for the names of strategies): trade is the same game as 
prisoners’ dilemma. Thus there are two kinds of equilibria: autarky (both 
keeping) with the null commitment pattern, and trade (both giving) with a 
commitment pattern in which each player subtracts an amount greater than 
one from his payoff in the situation where he alone keeps. 

There should be nothing counterintuitive about this analysis. What can 
make greedy rational people give away things they like? They will do so 
only if they can contrive making certain situations where they keep the 
good more unpleasant than those situations actually are. Trade can take 
place only if players selectively reduce their payoff functions through prom- 
ises and other strategic moves. 

(It may be objected that the possibility of “enforceable contracts” dis- 
tinguishes exchange economies from prisoners’ dilemma games. “Enforce- 
able contracts,” though, are the same as commitments: entering into an 
enforceable contract means arranging for a bad thing to happen to oneself 
under certain circumstances—arranging, that is for certain subtractions 
from one’s payoff matrix. The objection might be restated then, that certain 
types of commitments that are available to traders are not available to 
prisoners—it is an objection, in short, to the free disposal of utility axiom 
for the game with prisoners. Hence the objection could be met by saying 
that exchange economies are the same as the free-disposal version of pris- 
oners’ dilemma.) 

Thus, Pareto improvements never come without the proper commitments, 
and sometimes they do not come at all. That is why our methods will be able 
to explain persistent inefficiencies like unemployment and discrimination. 


Il 


Now let us consider bilateral exchange with divisible, rather than indivisible 
goods. 
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Let player | be endowed with one unit of good x, and let player 2 be 
endowed with one unit of good y. Thus a strategy for player | is an amount 
of good x to give to player 2, and a strategy for player 2 is an amount of 
good y to give to player |. We assume that each player's utility is given by 
the same Cobb-Douglas function. We have: 


S, =e =o at 
S, ={y, |OSsy», S13 
flan) =(1— 2) yf, at p= 
fia.) = xz (1 eae he Ope Ae 


The null commitment pattern and autarky, of course, form one equilibrium 
of this game. We will look for other equilibria involving two families of 
commitment patterns. 

The first family of commitment patterns that we wish to study is the 
family G”* of “naked trade” commitment patterns. 

A commitment pattern g’” is in the family G™ of naked trade commit- 
ment patterns if there is a vector (X}, ¥3, 7}, 7), with each element on the 
unit interval, such that g* can be expressed: 


81 (2.91) = fi%,d1) if xm< X and y= Dp 
= 0 otherwise 


27%) =a vi) Fo », <i and’ Seems 


= 0 otherwise. 


Player |’s commitment can be stated in words (addressed to player 2) as: “I 
promise to give you at least *} if you give me at least 7;. May lightning 
strike me dead if you give me at least 7; and I give you less than ¥;.” 
Similarly player 2’s commitment is, “I promise to give you at least 7; if you 
give me at least <3. May lightning strike me dead if you give me at least X; 
and I give you less than 77.” 

This naked trade commitment pattern is illustrated in the Edgeworth 
box of figure 2. Player I’s promise has made the shaded rectangular region 
marked (A) a region of zero utility for him; player 2’s promise has made the 
rectangular region marked (B) a region of zero utility for him. Player I’s 
promise affects the northeast corner of the Edgeworth box, where his utility 
is greatest; the same relationship holds for player 2 and the southwest 
corner. 

Now consider the acceptable situations for player 2 in this game, ({1, 2}, 
S, f—2@). If x, = 5, player 2 is best off if yp, = 57. If x, < 5, player 2 is 
best off if y, = 0. Hence 
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Figure 2 


0, Endowment 





AQ s")= {(0,)1)|»% = x and y, =j;} 
Uf, ¥1)|%2 <%; and y, =0}. 
Since player 2 is player |’s only opponent, 
A(2,2") = P(l,2") 
and a good situation for player | is one that maximizes 
Aan) = (Ix )* yt 


in A(2, g”). Clearly such a maximum will never be achieved in the second 
subset of A(2, g”), since y, =0 there means that player 1’s utility vanishes. 
The elements of the first subset of A(2, g”) differ only in their values of x,, 
and player | is better off the smaller the value of x,. Thus (<3, 7) maxi- 
mizes f, (*) in A(2, g”): 


Bl, g”) = (3, F1)}- 


In the Edgeworth box, player 1’s good set consists only of the corner point of 
player 2’s forbidden rectangle. By a similar argument B(2, g*) = {(%3, ¥)}. 
The intersection of good sets will be nonempty, of course, only when 


(1) 


and then will consist of the point (X,, ¥,). Thus there will be no equilibria 
associated with commitment patterns in the naked trade family that do not 
satisfy (1); however, there will be an equilibrium with (x,, j,) with any 
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Figure 3 


Endowment 





naked trade commitment pattern that satisfies (1). Thus there will be a 
naked trade equilibrium for every point in the Edgeworth box. With more 
general endowments, this result becomes that there will be a naked trade 
equilibrium associated with every point weakly Pareto-superior to the en- 
dowment point. 

A price system is another type of commitment pattern that can be used, 
and it is obviously one that we should study at some length. A price system 
(at least as we take the term to be understood in our simple example) 
depends on two parameters (as opposed to four for naked trades) which we 
call p' and p*. These parameters may be any positive numbers. Under a 
price system, player | promises: “Whatever amount )y, you give me, I will 
give you at least the amount p'y, of x.” Player 2 promises: “Whatever 
amount x, you give me, I will give you at least the amount p’ x, of y.” 

Let G’ denote the family of commitment patterns g” that are price sys- 
tems. A commitment pattern g’ is in G” if there is a vector (p', p’) € Rt 
such that g” can be expressed: 


8 (2,1) = fi (%.¥1) ft 3a Py; 
=0 otherwise 


BP.) Hho asa) ) ae 
otherwise. 


II 
o 


Figure 3 illustrates a price commitment pattern. Like a naked trade com- 
mitment pattern, a price commitment pattern makes the northeast corner 
of the Edgeworth box a region (marked (A) in figure 3) of zero utility for 
player 1, and the southwest corner (marked (B) in figure 3) a region of zero 
utility for player 2. Naked trade zero utility regions are always rectangular 
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while price zero utility regions are triangular or quadrangular; the naked 
trade regions may or may not touch or overlay, while the price system 
regions always come together at the endowment point. Player 2’s acceptable 
situations are 


Oke) 405,91) (9) = p? x}, 
and 
A(2,g”) = P(1,g”). 


Thus good situations for player 1 maximize his utility subject to y, =p? xp. 
By the usual calculation we have 


B(1,g”) = {(B, p’ B)}. 
Similarly 
B(2,g”) = {(p' a, a)}. 


The two good sets will coincide if and only if 


p' =1/p’ = Bla (2) 


in which case their common element will be (8, a). Note that this is the 
Walrasian equilibrium. 

Thus only those commitment patterns in G’ that satisfy (2) are associated 
with commitment equilibria, and all such commitment equilibria involve 
the Walrasian equilibrium situation. 

That the Walrasian equilibrium is the only commitment equilibrium with 
a price system commitment pattern does not, of course, mean that it is the 
only commitment equilibrium. We have already seen that a multitude of 
commitment equilibria with naked trades exist. There are even some very 
interesting equilibria with commitment patterns very similar to a price 
system. 

Suppose, for instance, that both players agree on a price different from 
the equilibrium price. Then player 2’s good point on the price line will differ 
from player 1’s; and lack of agreement rules out an equilibrium with this 
price line. To eliminate this conflict within the set of pure price systems we 
would have to switch to another price line. An alternative would be to 
change a player’s commitment pattern to prevent him from deviating from 
the other player’s good point. The way to do this is for the player to “ration” 
his sale of his good to the other player to the amount he would sell at his 
most favored point on the price line. This commitment pattern eliminates 
the zone of conflict and is associated with a commitment equilibrium more 
favorable to the rationing player than any other point on the prevailing 
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Figure 4 
Endowment point 


price line. It gives the rationed player, moreover, a result better than the 
Walrasian equilibrium. 

We can provide a concrete example of this phenomenon; it is illustrated 
in the Edgeworth box of figure 4. Let g* be given by: 


Bt Vi) Cady ee Spy; 


or x, > 8 
=0 otherwise 
(Nn) =Alasn) if »<(/p)» 
= 0 otherwise 


where we assume p > B/a, the Walrasian price ratio. For player 1, the 
acceptable situations have 


% =py, if y SB/p 
=B if y, = B/p. 


For player 2 the acceptable situations have, as before y, = (1/p) x. 
As before, B(1, g*) = {(B, p B)}, but finding B(2, g*) is more compli- 
cated. The goodness problem 


max x3(1 — y,)? 
2.N1 
Sit 
= PV th nie 
sys! if y, =B/p 


cannot be solved with only the first constraint binding since B/p < a; 
rather the solution is at the kink in figure 4: 
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B(2, 2") = {(B,p B)}. 


Thus (g*, (8, pB)) is an equilibrium. 

It is easy to show that player | is worse off in this equilibrium and player 
2 is better off than in the Walrasian equilibrium. We saw above that in the 
Walrasian equilibrium 


Vi — a 
3 = [6 
x, has the same value at both of the equilibria. In the rationing equilibrium, 


however, y, is smaller. Since greater y, helps player | and hurts player 2, 
the conclusion is obvious. 


Ill 


Use of money can add a new wrinkle to our discussion of the two-person 
two-good economy. Since most economic transactions are by money, not 
by barter, it seems worthwhile to see how money works. 

The type of money that we will use is absolutely worthless —it enters 
into no utility function—and not even inherently scarce. It acquires its 
“value” solely by social convention. It is thus quite similar to a checking 
account or a credit card. Such money is thus a bit more ethereal than the 
fiat or commodity money that economists more commonly use, but it seems 
no more ethereal than the real thing: people accept checks because they will 
make accounting entries and write checks themselves. Nothing with sub- 
stance moves; there is only a series of debit and credit entries on agents’ 
accounting books. 

The players’ strategy sets must be expanded when we consider an econ- 
omy with money. Each player must determine not only the amount of his 
good that he will give to the other player, but also the amount of money he 
will give the other player. Thus a strategy for player | is a pair (x), m)) 
where m) denotes the amount of money player | gives to player 2, and a 
strategy for player 2 is a pair (y,, m{) where mj denotes the amount of 
money player 2 gives to player 1. We call this new strategy space S”. We 
need a new payoff function: 


Wie (ean); (1,75) = f(y ). 


The players {1,2} remain the same, but the game ({1, 2}, 8”, f’")* which 
we will be studying here is, of course, a different game from ({1, 2}, S, f)* 
which we studied in the previous section. 

Let us experiment with the following price system commitment pattern: 
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Bi ((x2,3), (1,1) = fi 21) if x, <p'm{ (3a) 
or if m, > m;j (3b) 

= 0 otherwise (3c) 

82((x2,2), 1,1) = fia, 91) if y<p'm, (3d) 
or if m, >m\ (3e) 

= 0 otherwise. (3f) 


In (3a), player | promises to give player 2 at least the amount p' m7; of x 
if player 2 writes a check for m;. In (3d), player 2 promises to give player | 
the amount p’m} of y if player I writes a check for m}. In (3b) and (3e) 
players | and 2 respectively promise that they will not overdraw their 
checking accounts. 

If player 2 chooses the strategy (,, ;), player 1’s acceptable situations 
are those which satisfy: 


x» =p mM; (4a) 
m, < mi. (4b) 


Similarly if player 1 chooses the strategy (x,, m}), player 2’s acceptable 
situations are those which satisfy 


y= pm, (sa) 
m, =m). (5b) 


Note that both players’ acceptable situations are quite numerous; since 
money does not enter into the payoff function a player’s only concern at 
this level is avoiding an overdraft. Note also that while the amount of good 
a player receives from the other player matters to the recipient, the recipient 
treats it as a fait accompli that does not affect his choice of strategies. 

For a situation ((.x,, 77}), (),, ;)) to be an NE, both (4) and (5) must 
be satisfied. Combining (4b) and (5b): m; =m} => m‘{ hence 


‘4 
re ee (6) 


For any m > 0, then, ((p' m,m), (p> m,m)) is an NE of ({1, 2}, S”, 
f — g); there are no other NEs. 

For an equilibrium to be possible with g, there must be Unquestioned 
Superiority among these NEs. For there to be Unquestioned Superiority, 
the best NE for player | must also be the best NE for player 2. For each 
value of m there is a unique NE; thus we may consider each player’s utility 
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at that NE as a function of m. Let M; denote the m that maximizes player 
i’s utility, i = 1, 2. Then Unquestioned Superiority means M, = M). 
To find M, we must maximize 


In v,(m) = aln(1 — p'm) + Blnp’m. 


Differentiating with respect to m 


al ap! 
nv, (m) et we i B Nie 
om fo pom m 
whence 
Ve — Bip . (7) 


Similarly for player 2 we must maximize 
Inv,(m) = alnp'm+ Bln(1 — p’*m), 
whence 
M, = a/p’. (8) 
Comparing (7) and (8), a necessary condition for an equilibrium is 
Bie = ajp, or 
pip’ = Bla (9) 
(which is the Walrasian equilibrium price ratio). From (7), (8), (4a), (5a), 
xX, = (B/a)a = B (10) 
yy =a 


(which again is the Walrasian equilibrium). 

Equations (9) and (10) are necessary for an equilibrium, but are they 
sufficient? Consider player 1 and set p> = | as numéraire. The set of pos- 
sible points P(1, g) for player | are given by (5): 


PC, g) = (2,7), (,771)) [1 = 3, mS my}. (11) 
Player 1’s utility at (10) is 
(1 — B)°a® =a. 


By the possible point theorem the question becomes whether there is a 
situation s € P(i,g) such that f,(s) > a@. Of course there is: x, can be 
made as small as desired and m} and hence y,, as large as desired in P(1, 
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g); a utility of | (the physical maximum) is attainable. Thus there is no 
equilibrium with a commitment pattern like g. 

Why does this commitment pattern fail? Essentially because it lacks “en- 
forcement.” Compare the commitment pattern in (3) with, for instance, the 
commitment pattern in the prisoners’ dilemma game where neither player 
confessed. In prisoners’ dilemma, player 2 “enforces” good conduct on 
player | because player | knows that if he confesses, player 2 will also. 
Similarly in barter, player 2 “enforces” good conduct on player | because 
player | knows that if he reduces the amount of good x he gives to player 2, 
player 2 will reduce the amount of good y he gives to player 1. In (3) and 
(11), per contra, there is no enforcement: player 2 will act the same way no 
matter whether player | gives him the good x to which he is “entitled” or 
not; no matter whether player | overdraws his checking account or not. 
(Symmetrical statements, of course, hold for player 2.) The enforcement 
problem is a major difference between barter and monetary economies, and 
is the reason why the commitment pattern in (3) does not have an equi- 
librium. 

Several ways of providing the required enforcement come to mind. The 
first way would be to add a third player, an Enforcer, who is indifferent 
among all situations in the game involving players | and 2, but who threatens 
to employ a strategy that will reduce that player’s payoff to zero against any 
player who deviates from “good conduct.” There are two problems with this 
approach: the first is that “good conduct” is not well-defined and tyrannical 
outcomes are not what we are interested in at this point; the second is that 
an additional player can be a large complication. We will forgo the Enforcer 
at this point, therefore, although we will need a player something like this 
when we talk later about less simple and more realistic matters. 

The approach we take, then, will be more in the spirit of the prisoners’ 
dilemma and barter games, where each player enforced good conduct on 
the other. Each player will honor the other’s checks only if the other is not a 
“deadbeat.” This is not a bad approximation to reality —one very important 
reason why people pay their bills is that they anticipate serious problems if 
their credit ratings are bad.' Thus we consider the revised commitment 
pattern g’: 


81 ((X2,73),(91.7))) = fi 251) if x, <p'm; (12a) 
and y, 2pm) 
and m, <m) 


1. It is a good approximation to the Brehon code: “he who evades his legal responsibilities 
shall not be paid by God or man” (Brehon Laws 1.113). 
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or if m, <m; (12b) 
= 0 otherwise (12c) 
g3((X), 3), (9, 74)) = fy (V1) if Ji < pm, (12d) 


and x, >m; 


2 1 
and m, 2m, 


or if m,< mi (12e) 
= 0 otherwise. 


We can, in fact, further simplify the commitment pattern by removing 
(12b) and (12e), since they are used only for (4b) and (5b) which now 
follow from (12a) and (12d) if trade takes place: One does not have to 
promise not to overdraw, one need only to be threatened with the conse- 
quences. With g’ as in (12), the argument of (4)—(10) goes through exactly 
as before. In particular, the necessary conditions in (9) and (10) for an 
equilibrium are still necessary. 

The test is the possible point theorem. Substituting (12) for (3) we have 
for player 1I’s possible point set P(1, g’): 


P(1,g’) = {(),m}),(1,)) |p) =m), %» = (B/a)m; (13) 
and m,; = m}} 
U {(x),3),(1,77)) |) =O and x, <(B/a)m; 


B 
or m, < m3}. 


For all points in the second subset, /,(-) since y, = 0; hence these present 
no problem. To apply the possible point theorem, then, we must find the 
situation in the first subset of P(1, g’) that maximizes player 1’s utility. It is 
obvious that at such a maximizing point equality will hold in each of the 
three expressions that define the subset. Then we can write player 1’s utility 
as a function v,(-) of m =m, =m}: 

Inv,(m) = aln(1 — (B/a) m) + Binm. 


This is precisely the same expression we maximized before in trying to find 
Unquestioned Superiority, with the constraints p' = B/a. Thus 


m= M, = B/p' =a. 
In (13): 
ie OL) >) — B- 


Hence no point in P(1, g’) is more favorable to player 1 than the proposed 
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equilibrium NE. Similar reasoning prevails for player 2. Thus the “Wal- 
rasian” equilibrium 


(2°, ((B, a), (a, @)) 


is a commitment equilibrium of ({1, 2}, S”, f’”). All other equilibria in this 
family are “inflationary” replicas of this: pairs with all prices and money 
multiplied by the same constant. 


IV 


We have exhausted for now the interesting things we can do with two 
players. Let us expand by adding a third player and a third good. With 
three players and three goods, we can pose some new questions about a 
barter economy. 

Specifically, let the three goods be called x, y and z, and let player I’s 
endowment be a unit of x, and nothing else, player 2’s endowment be a 
unit of y, and nothing else, and player 3’s endowment be a unit of z, and 
nothing else. Let each player gain positive utility from consumption of his 
own good and one other. To make the problem interesting, let the other 
good for player | be y, for player 2 be z, and for player 3 be x. 

Specifically let: 


=a B 
u(*) = xii 
ib) = YizZp 

= B 
Uu;(*) = 23x}. 


The Walrasian equilibrium for this economy is given by the price relation 
P, =P, = p, and the following allocation: 


Player | Player 2 Player 3 
Good x a 0 B 
Good y B a 0 
Good z 0 B a 


First let us consider price system games without money. The players’ 
strategy sets are given by 


Ss =S,XS,XS, 
{(x41, %», %) ER2| > x, =1} 


S| 


S; = {( i> Y2> Vs) = R?| >i = 1} 
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3 = (ers a Zs) ER} | > 2; ae 1} 


and payoff functions are given by /; (-) = wu; (-). As usual, no trade is the sole 
NE of ({1, 2, 3}, S, f). The game we are interested in is ({1, 2, 3}, S, f)*. 

The first commitment pattern we wish to look at we can call “nonmed- 
dlesome” barter. By “nonmeddlesome” we mean that for any two players, 
the amount the first gives the second depends only on the amount the second 
gives the first; what either player does with the third player is entirely 
irrelevant to the transaction between the first two players. In general, g’” € 
G’™ the set of nonmeddlesome price system commitment patterns, if there 
is a vector p =(P5, D3, P1, P3, P,P») ER such that g?” can be expressed: 


GWG), Val or—ppy;, Ont x <p, 7, (14) 
= ()) otherwise 


Cr eit yy <p; x Mor ify," <pyz, 
= 0 otherwise 


eC) = PC ily 24) Pi 4, sOtuil | Zz) =< pn Ps 
= 0 otherwise. 


Thus what each player promises to give depends only on what he has 
received from the player to whom the gift is contemplated. 

(14) allows us to characterize acceptable situations. These have, for 
player | 


X = pry 
x3 = p32 
for player 2 
Vi == pi Xy 
V3 aa p3 225 


and for player 3 

Zi No p} X3 

Laat p> J3- 

Thus, we have 

Pg”) = hin = Pie: Vai P32, 2. pi Xa, 2 = p2)3} 
and hence, by maximization 

Bil, gi) a {s| x, = 18, JV = iB, Z| = X3 = 0} 
if ono2) = 1, and 
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B(l,g"") = {s|x. =B, = piB, 2, = x; =y; = 2 =0}, 


if not. 
Similarly 


B(2, 2") = {s|y; =B, 2 = 2B, » =, =0} 
if p; p; = |, and 
B(2, g””) = {s|y; = B, 2 = p>B, %=y =x =z =9} 


if not. 

Without even considering B(3, g””), then, we can see that there will 
never be an equilibrium with a nonmeddlesome commitment pattern be- 
cause players | and 2 will never agree on x, and »,, no matter what the 
value of p. Thus a commitment pattern like g”” is useless. 

The reason why it is useless is easy to see. Player | wants what player 2 
has, but player 2 does not want what player | has. Instead player 2 wants 
what player 3 has, and player 3 wants, not what player 2 has, but what 
player | has. Trade, to be effective, must be more roundabout than the 
nonmeddlesome price system will allow. 

Three ways to correct this difficulty come to mind immediately. The first 
way is to allow players to buy goods which have no utility for them in order 
to resell them to players who value them. Such activity, however, is impos- 
sible to model in an atemporal context, since each player's feasible dona- 
tions to the others depend on what the others give him, and thus will not be 
determined until after the game has begun. 

The second way to correct the difficulty is by using a “meddlesome” 
commitment pattern. A meddlesome price system is one like g™: 


g(*) =" fit") ft <= py 


= 0 otherwise 
e()=AC) if 1 <p?z 
= 0 otherwise 
ss ch=fC) if 2 <px; 
=0 otherwise. 


A necessary condition for ({1, 2, 3}, S.f—g”™) to have an NE with trade is 
p' pp =1, and it can be shown that the only commitment equilibria with 
g”” is that corresponding to the Walrasian equilibrium with all prices equal. 

The promises in g” are rather unusual, though. Player | promises player 
2: “If you give me y, of », I won't give you anything, but I'll give player 3 
the amount p' y, of x.” Player 2 promises player 3: “If you give me z, of z, 
I will give player | the amount p° z, of y.” And player 3 promises player 1, 
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“If you give me x; of x, I will give player 2 the amount p°x; of z.” In one 
sense, these promises accomplish in an atemporal context the type of sale- 
and-resale that we suggested as the first way out of the difficulty of round- 
about trade: player 2, for instance, instead of ever holding any of good x 
himself, can arrange for player | to deliver the appropriate amount of it 
directly to player 3; in return, he receives good z from player 3. This inter- 
pretation is, however, somewhat metaphorical: the plain fact is that the 
subject of discussions between two players is not solely what goods are ex- 
changed between the two, but also how a third player is treated. This is the 
reason we have called the commitment pattern “meddlesome,” and why 
there are doubts about its general usefulness. 

The third way out of the roundaboutness problem is, of course, money. A 
player can sell his good to the player who desires it, receive money in 
return, and use this money to buy the good he desires from the third player. 
This approach seems to be fairly realistic; indeed, roundabout trade seems 
to be the basic reason why a “medium of exchange” is useful. However, 
because of the “enforcement” provisions there may be some questions about 
whether this sort of monetary economy is truly less meddlesome than a 
barter economy. 

To study a monetary economy, as we saw in the previous section, we must 
define a new game ({1, 2, 3}, S”, f”). To reduce the dimensionality of 
strategy space, we will assume that no player gives any of his good to the 
player who does not derive any utility from it, or any of his money to the 
player whose good he derives no utility from. Thus a strategy for player | is 
a pair (x;, m), a strategy for player 2 is ( y,, m3), and a strategy for player 
3 is (2), mj). As before, f” maps from S” by ignoring monetary phe- 
nomena, and assigning utilities to real phenomena only. 

Let us then look at the commitment pattern g”: 


a1'((%3,72),(01,3), (2,7) =A) — if x5 < pm (15) 
and m, <m; 
orif jy, Ap m: (15b) 
= 0 otherwise 
a) =A) ify p ms (1§c) 
and m;, => mj 
Onl iz5.. 75 pm; (15d) 
= 0 otherwise 
eC) GC) if 2 < pm (15e) 
and m, > m; 
ori a; 4p mm (15f) 


= 0 otherwise. 


84 SPECIFIC 


Each player’s commitment in (15) has two parts. Each player as a seller 
promises to deliver to his buyer at least the amount determined by the 
buyer’s payment of money to him and his own asking price p‘. This is done 
in (15a), (1§c), and (15e). This promise is contingent on the buyer’s check 
not bouncing. Each player as a buyer promises to pay his seller / neither 
more nor less than his (the buyer’s) bid price p/ for each unit of good 
delivered. This is done in (15b), (15d) and (15f). 

Acceptable sets also have two parts, depending on whether buyers over- 
draw. Thus we have 


A(l,e) = Ange) Cae) 
A(2,g")= A Re) UA 2") 
AGE) = Aig Uy Ae), 
where 
Al(1,g”) = {s|x; = p'm, y, = 6 m,, m S m3} 
A*(1,g") = {s|x, =0, », = p’m,, m) > m3 
A'(2,8") = {s|y1 = pm, 2 = pm}, m, S mi} 
A’(2,g”) ={s| y, =0, 2 = p’mj, m, > mj} 
A'(3,2”) ={s|z =p’ m3, % =p m), m; =m} 
A’(3,g”) = {s|z, =0, x, = p'mi, m3 > m}}. 
The possible set for player | is 
P(1, 2") = AGE) Gia > 
=[A'(2,g") 1 A'G,8")] U[A'(2,.8") 1 A°B.8") 
U[A*(2,8") 1 A(3,8”)]. 


Consider A! (2, g”) N A2(3, 2”). In A?(3,g”), 22 =0. In A'(2,g”), z. = 
f° m3, where f; is positive. Hence in the intersection, if it is nonempty, m; 
=). In A*(3,g”"), however, m; > m}. Hence in the intersection, 0 > m). 
But this is impossible. Thus 


A'(2,2") 0 A*(3,2”) = 0. 


In A*(2,g”), y; = 0. Thus in the intersection of A*(2,g”) with any- 
thing, f, (-) = 0. The good set for player | will not be in A’(2,g”) if a 
positive payoff can be achieved anywhere in P(1,g”). 

So we are left to consider only 
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AliQve” if) AGie”). 


Inet (2, 2”), z, =p m:.In A’(3,g”), z =p ms. Thus the intersection 
will be empty unless 
ce (16) 


If (16) does not hold, player 1’s good set is in A*(2,g”) and at any equi- 
librium /; (-) = 0. If (16) holds, then player 1’s goodness problem is 


max i(s) = (Cl — og) eye site 
e4n@,8) 1 A G.2")) 
2g) SS eee a i uihe ye Sian, oh anaes Sie 

Solving this, we find that player 1’s good set is 

B(l,g”) = {s|m; Sm, =m; = Bla, = (0/6 )B, 

2 =p m3, x; = B} 

if (16) holds, and 

Bee) =A: (2527) MAG 2"); 


if (16) fails. 
By similar reasoning for players 2 and 3 


B(2,g") = {s|m, Sm, =m; = 86/6, y, = B, 2 =(0'/6')B, 


25) p my} 
p'=6', (17) 


B(2,g”) = A°(3,g") N A(1,g”), 
if not; 
B(3,g”") = {s|m, Sm, =m; =B/p’, », =p mM), 2 =B, 


XS (p'/6°) B} 


ip (18) 
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B(3,g”) = A*(l,g”) MN A(2,2”) 


if not. 

If (16), (17), and (18) hold—if buyers and sellers agree on price —then 
we have a Walrasian equilibrium, if any; for the good sets will have a 
nonempty intersection only if 


D oe 2 ae 

p =p =p =p 
and the only situation in that intersection will have 

m, =m; = m; = B/p, y) = 2 =% =B. 

Should any of (16), (17), and (18) fail there will be no equilibrium. If one 
fails while the other two hold, then the intersection of the good sets with 
positive payoffs will have positive values for y,, z,, and x,. The good set 
for the player with zero payoff will have a zero value for one of these three 


variables. If two or more fail, the intersection of the good sets will be empty 
unless at least one of 


A*(2,2") 1 A*(1,g”) 
A?(2,2") M A’ (3,2) 
A127) OAC.) 


is nonempty. But all are empty. Consider, for instance, A*(l,g”) 
A’*(3,g”). In A*(1,g”), m, > mj. In A’(3,g”), m; > m}. Hence in the 
intersection 


m, > m),. (19) 


In A7(1,g”), x; = 0. In A?(3,g”), x° = p' mi, p' > 0. Hence in the 
intersection m, = 0. Combining this with (19) we conclude 0 > m}, which 
is impossible. Thus this intersection is empty. The demonstration for the 
other two intersections is similar. 


Vv 


These problems, as we have seen, can grow very large, even if we strive 
determinedly to deal with only the most elementary of systems. The diffi- 
culties can only increase as we progress, since our true interests lie in prob- 
lems that are not at all elementary. 

A more powerful method, however, is available. We call it “supergood- 
ness.” Let P(i, g) denote an arbitrary superset of P(i, g): 


P(i,g) D P(i,g). 
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We will call P(-,-) player i’s super-possible set. Next we define i’s supergood 
set B(i,g) as the elements in P(i,g) that maximize i’s payoff: 


B(i,g) = {s € P(i,g)| (V5 © Pli,g)) fils) = f@)}- 
Then we have the following theorem: 


Theorem 9. (Supergoodness) If s €[; Bli,g) \ N(g)], then (g,s) is an 
equilibrium. 


Proof. Since s € N(g) by hypothesis, we must show that s is not beaten. 
Suppose (g’, s’) beats (g, 5s) through i. Then by the possible point theorem 
SaeiP(r 2 )jand 


Fi (s’) > f(s). (20) 


Since s’ € P(i,g) and P(i, g) C P(i, g), we know s’ € P(i, g). Since, then, 
(20) and s’ € P(i,g), we conclude s ¢ B(i,g). Hence s €[N; Bli,g) O 
N(g)], a contradiction. @ 


The Supergoodness Theorem is useful because NEs are easy to come by: 
in most of the games we deal with, NEs require only that the commitment 
pattern exhibit a very slight degree of internal consistency and that players 
honor the commitments they make. The theorem allows us to add anything 
we wish—even impossible situations, old shoes, Genghis Khan, or your 
neighbor’s dog—to any player’s acceptable set before we perform the diffi- 
cult maximizations, and lets us change what we add when we do the next 
maximization. Of course, adding old shoes does not make maximization 
problems easier. What does make them easier is dropping constraints —and 
since dropping constraints is the same thing as adding to acceptable sets, 
the Supergoodness Theorem allows us to drop almost at will. “Almost” 
because there is a final accounting—the intersection of the supergood sets 
must be nonempty. If it is empty we can conclude nothing, since it might 
have been nonempty if we had chosen different superpossible sets. Thus 
there is some art involved in choosing which constraints to ignore in finding 
which player’s supergood set. 

Supergoodness, moreover, while it is perhaps primarily a crutch for lazy 
mathematicians, also allows us to understand more fully what is meant by 
Walrasian equilibrium, and why it so often, as we have seen in this chapter, 
coincides with a commitment equilibrium. The Walrasian equilibrium prob- 
lem may be formulated, roughly, like this: There is a price commitment 
pattern. Each agent is imagined to solve a maximization problem in which 
the maximand is his utility, the instruments are the amounts of goods and 
services he gives to others and receives from others, and constraints are of 
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two types. The agent is constrained, first, by his inability to give out and 
keep more than his initial endowment, and second, by the fact that the 
amount of goods and services he receives from others is determined by the 
amounts he gives them, with the precise relationship between what is given 
and what is received being given by the price system. These two types of 
constraint are generally consolidated into one expression called a budget 
constraint. A price system is called a Walrasian equilibrium price system if 
the solutions to the agents’ maximization problems are consistent with one 
another in the sense that for each commodity the amounts that agents want 
to give to each other are the same as the amounts they want to receive from 
each other. It has, of course, been shown that in many cases Walrasian 
equilibria exist. 

Now suppose we were trying to find a commitment equilibrium involving 
a price commitment pattern. If we used the goodness theorem, we would 
also maximize each agent’s utility. The goodness problem, however, would 
differ from the agent’s Walrasian maximizing problem in two respects: first, 
the maximization would be over all the transactions in the economy, and, 
second, the constraints would be all the feasibility constraints and all the 
acceptability constraints (except the agent’s own) in the economy. The Wal- 
rasian maximization problem, by contrast, is over only those transactions 
that affect the agent directly as a donor or recipient. It includes only those 
feasibility constraints that limit what the agent himself can give away, and 
only the acceptability constraints that limit what others give the agent 
himself. 

If we proceed by supergoodness, however, we can ignore this difference. 
Specifically, supergoodness allows us to drop all constraints in an agent’s 
goodness problem that do not appear in the agent’s Walrasian maximization 
problem. In this case, the agent’s supergood set consists only of situations 
where his transactions are identical with the transactions that solve his 
Walrasian maximization problem. The supergood sets formed in this man- 
ner have a nonempty intersection iff the solutions to agents’ Walrasian 
maximization problems are consistent with one another. If they are consis- 
tent, the Walrasian and commitment equilibria coincide. 

We see, then, that Walrasian equilibrium is a very specialized kind of 
commitment equilibrium and Walrasian rationality is a specialized kind of 
commitment rationality. This is just a further instance of our general result 
in chapter 3. 


7 » Simple Economies with Time 


And indeed there will be time 
To wonder, “Do I dare?” and, “Do I dare?” 


T. S. ELIOT, “The Lovesong of J. Alfred Prufrock” 


Atemporal worlds are nice, but most things that are interesting occur in 
time. People learn things as their lives progress. Atemporal games, for in- 
stance, cannot deal with production, because employers cannot reasonably 
be expected to decide how much output to supply to customers until they 
know how much labor workers have provided and thus what the level of 
output is. Fortunately, in chapter 4 we have already seen how to treat the 
extensive games that can formalize these difficulties, and although we dealt 
there primarily with finite games, we should have no difficulty applying this 
theory to economic games. 


I 


Let us start with a simple problem, and consider a world with two players, 
no money, one good, and two time periods. The good is durable, and we 
will refer to it as y. Player | receives one unit of good in period 1, and none 
in period 2. Player 2 receives one unit of good in period 2, but nothing in 
period |. Each player’s utility is the same Cobb-Douglas function of first 
and second period consumption. If we denote by c; the amount of good 
consumed by player / at time ¢, we have 


Inu; =alnc, + Blnc,, at Bp=1. 


We will confine our attention to pure strategies, and perfect equilibria. 
The first vertex in the game belongs to player |. A local strategy for player 
1 at this information set is a pair of nonnegative numbers (5, c}): V> is the 
amount of good he will give player 2 at this time, and c; is the amount he 
will consume in this period. This local strategy is subject to the constraint 


ee cya (1) 


i.e., player 1 cannot use more than his endowment. 
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Whatever (5, c}) player | chooses, the next information set belongs to 
player 2. For each (}, c}) that player 1 chooses there is in fact a different 
information set for player 2. His local strategy at any one of these informa- 
tion sets is a triplet (cj, yj, ¢3) of first period consumption c?, second 
period donation to player | yj, and second period consumption c3. The 
local strategy at the information set associated with (y}, c}) is subject to the 
constraints: 


sy, (2) 
yi “iF re <a) + y} = Cc. (3) 


Player 2 cannot consume more in period | than he receives from player | 
then, and he cannot use in period 2 more than the unit he is endowed with 
and whatever he saves from period |. 

The final information set belongs to player 1, and there is one corre- 
sponding to every pair of (y}, c;) and (cj, ¥;, C3) previously picked by 
players | and 2 respectively. (Equivalently we could put all vertices with the 
same c; in the same information set.) At each of these information sets 
player 1 chooses a second-period consumption c} subject to 


Cy yp ee ae (4) 


Second-period consumption cannot exceed savings from period | plus 
period 2 donations from player 2. 
Let us examine the following family of commitment patterns: 


gc)=AC) if yi < py) (5a) 
=0 otherwise 
at)=fA-) if yi < py, (sb) 
or if yi > py} (5c) 
=0 otherwise 


(5b) gives, as it were, player 2’s primary promise: he promises to repay 
player | at least p times whatever is received in period |. (5a) and (Sc) are 
essentially enforcement commitments: in (5a) player | lets it be known that 
he will be mortified if he is not sufficiently repaid, while in ($c) player 2 
invokes similar mortification upon himself if his repayment is too great. 
Let us consider first situations acceptable to player 2. Since it is perfec- 
tion we are interested in, we will act as if each of player 2’s information sets 
is reachable. Whatever (y}, c;) is, then, player 2’s acceptability problem is 
max. alnc; + Blinc; 


Cpe C2 
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subject to (2), (3), and 
yi = pyr 
yi = pyr. 
These last two inequalities obviously imply 
Vi = py (6) 
which, together with 
c; = min[y3,a(1 + (1 — p)y3)] (7) 
igs — 1 ty, — Cj (8) 


give the necessary and sufficient conditions that all its local strategies for 
player 2 have to meet for a situation to be acceptable (with perfection) for 
player 2. 

Acceptability for player | is a bit more complicated, since player 2’s 
response to a choice at the origin must be anticipated. A strategy for player 
2 is a choice of (cj, y;, c3) at every information set (, c;). Thus for an 
arbitrary strategy of player 2 we may write 


Yi = yi (2, 1) 


(and similar expressions for cj and c; but these do not interest us). Then to 
find acceptable situations for player 1 we must 


1 1 
max alnc, + Blnc;, 


A tl ~ 
Cys V 2902 


subject to: 
Py, =i (ci, ¥2) (9) 
ytad Sl (1) 
SN saa C1 tis V2) (4) 


Clearly (9) will be binding if either (1) or (4) are, and both of them will be. 
Thus we know that (9) will be binding at any situation acceptable to player 
1. There are obviously other conditions for acceptability, but supergoodness 
will let us ignore them. 

To find the values of the variables at good situations for player 1, we 
maximize his utility subject to feasibility and acceptability to player 2: 


1 
max alnc,; + Blinc, st. 
(all variables) 


ytad sl (1) 


Sie (2) 
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yi te sl ty, 4 (3) 
6 Sy en ee (4) 
Yi = py (6) 
cy = min[y}, a(1 + (1 — p)¥)] (7) 
ytd =lty, —c. (8) 


Since (8) implies it, (4) may be ignored; by supergoodness we will choose 
to ignore (8) as well. Similarly we will drop (2) and (7). Clearly (4) will be 
binding; we will substitute from (6) and use its RHS in the maximand. 
Thus the supergoodness problem is: 


max alnc, + Bln(l — c, +(p — I)y2), st. 

ytad <li. (1) 
There are three cases to consider: 
(1-A) If p—1<0 then 


c 
yy = yy, =0 
Le EE 


oS 
II 


(1-B) If —1=0, y} can take on any value less than or equal to B and 


For player 2, we take the supergoodness problem as 


max alnc; + Blnc3, s.t. 
ee 


(ee foe ee 
Cpe CONIC 


i (2) 
vile. yn) ta Silty — cj (3) 
BY, = Vilets ¥2)- (9') 


Since all that matters to this optimization problem is the value of y{(-) at 
(c}, v3) and there are no continuity constraints, we need not maximize over 
the function, but only over the value, which we will write simply as Vie 
Thus we have 
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pyr = Yi. (9!) 
Notice however that 

Yi = pyr (8) 
is a necessary condition for a situation to be good for player 1. There is no 
equilibrium except when equations (6) and (9!') both hold; thus there is no 
equilibrium with trade unless p = p which we henceforth assume to be 
the case. 

Returning to player 2’s supergoodness problem, we see that clearly (3) 


will be binding. Using (9'!) and substituting from (3) into the maximand, 
we have 


max alnc; + Bln(1 — cy +(1 — p)y), St. 
a =y, (2) 
Again there are three cases: 


(2-A) If p—1<0Othen(1l — p) >0 and the supergoodness problem has 
no solution, as y, increases beyond all bounds. 


(2-B) If p —1 =O then cj; =aand c; = Band y, can take any value 
greater than or equal to a, and y; = y). 


(2-C) Ifp—1>0, then(1 — p) <0 


Now we must find out if there are any circumstances under which the 
two sets of supergoodness solutions agree. 

Clearly they will never agree if cases (1-A) and (2-A) prevail, for in the 
former y, vanishes while in the latter it increases beyond all bounds. Even 
if we modified our supergoodness approach and included a few more con- 
straints, it is unlikely that we could produce agreement in this case, for 
when p < 1, the players’ interests are fundamentally opposed. 

Agreement is not impossible in the B cases. When p = I, a situation with 
any value y} < B is supergood for player 1, while a situation with any value 
y} = ais supergood for 2. Thus there can be agreement iff 


ax<B (10) 


in which case any y) satisfying a < y, < B will be supergood for both 
players. Then it is easy to verify that the doubly supergood situations with 


94 SPECIFIC 


1 2 
ya. = V4 
Ln) Se 
Cc; sal ef ——n 
ee es pe 
¢, =c, =B 


are NEs and hence (by the Supergoodness Theorem) equilibria with the 
p = p = | commitment pattern, provided (10) holds. (10), however, is a 
rather unusual condition —it requires that players value future consumption 
at least as highly as present. Economists, however, generally believe that 
the contrary is true; hence the equilibrium we have found cannot leave us 
satisfied. 

Fortunately, agreement is possible in the C cases iff (10) does not hold. 
When p > 1, player I’s supergood situations have y} = B while player 2’s 
supergood situations have y; = a/p. For agreement we need B = a/p,i.e., 
p =a/B. Now p = a/B > | as required for case C iff 


a>B (11) 


1.e., iff (10) fails. It is easy to verify that given p = a/ B, players | and 2 
agree on the remaining variables: 

c=yi =¢) =a 

d=l=d =p 
and that the situations with these values are NEs. Hence those situations, 
along with the 6 = p = a/ 8 commitment pattern, are equilibria whenever 
(11) holds. Thus we have found equilibria for every possible value of a and B. 

There is nothing unusual about these results. When future consumption 
is at least as valuable as present, players will trade future against present 
equally, many situations are compatible with equilibrium and each player 
will follow the same pattern of increasing consumption. In the normal case 
where present is preferred to future, there will be a premium on present 
consumption, each player will follow a pattern of even consumption over 
time, and the player whose endowment is of the more valuable good —the 
present time good—will be better off than the one who receives his en- 
dowment later. 

The results also coincide with a Walrasian equilibrium. Although we 
talked about “supergood sets” and “agreement” while the Walrasian ap- 
proach talks about “demand correspondences” and “market clearing,” be- 
cause of the way we chose super-acceptable sets the mathematical operations 
we performed were the same as those that would be performed to find a 
Walrasian equilibrium. 

Note, however, that we never considered “expectations,” even though in 
any actual play of the game player | would no doubt think about how 
much, if anything, player 2 would repay him in period 2, and these thoughts 


SIMPLE ECONOMIES WITH TIME 95 


would influence his actions in period 1. Our interest, though, is not psy- 
chology. Only the patterns of actions and commitments that are equilibria 
will leave all players without regret at how they played the game—that is 
one way we defined equilibrium. If an actual play is not an equilibrium 
somebody is making a mistake. (In this sense every commitment equilib- 
rium is a rational expectations equilibrium.) I do not wish to deny that 
people make mistakes; original sin has been said to be the only empirically 
verifiable proposition of theology. Psychology may in fact be able to say 
some interesting things about how people make mistakes. But economics 
has been well served heretofore by its assumption of rationality, and a 
disquisition on mistakes and irrationality could hardly be called economics. 


II 


The problem we have just discussed did not involve money, although it 
could have. If it did, it would have had to use the “credit-card money” we 
used in chapter 6. This was sort of slippery stuff that had the property of 
coming from nothing and disappearing by the end of the problem. People 
had to be looking over each others’ shoulders constantly to prevent abuses, 
but everyone wandered around with omnipotent credit cards and unlimited 
overdraft privileges. 

With explicit time, we can consider another, perhaps more realistic, kind 
of money: paper money (or certified checks). Like credit-card money, paper 
money is not desired for itself: it enters into no one’s utility function. It 
differs from credit-card money in two important respects. First, someone 
has a fixed endowment of it at the beginning of the game; it does not spring 
into being merely by assertions. Second, the constraints against overspend- 
ing are technological, not part of the commitment pattern: if all you have is 
five dollars, you cannot give away more than five dollars no matter what the 
other players think or do. 

Paper money, however, makes eschatology a crucial issue. Suppose there 
is a day on which the world will end. The folk saying is true about paper 
money: you can’t take it with you. Hence we may be assured that there will 
be no going-out-of-business sales the day before Armageddon, since the 
merchants will never be able to spend and thereby enjoy the money they 
would realize from those sales. In general, then, money will be useless the 
day before Armageddon, and so no one will want to hold any money bal- 
ance at the end of the day before the day before Armageddon. Thus money 
will be useless then too. In this manner we can continue backwards as long 
as we wish, and conclude that no one will ever want to hold paper money if 
the world will end someday, no matter how far in the future Armageddon is. 
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To understand paper money, then, we must assume away the end of the 
world (a bold assumption, indeed). We will consider an overlapping gen- 
erations game a la Samuelson (1958) with a countable infinity of players 
and a countable infinity of time periods. Denote by t= 1, 2,... , the time 
periods. In each period a new player is “born,” and we will name him after 
his birthday. Player ¢ “lives” for two periods: in period ¢ he is endowed with 
one unit of a durable good, and in period (¢ + 1) he is endowed with 
nothing. He consumes ¢; in period ¢ and c;"' in period (t + 1), and his 
utility is given by 

Inu, =alnc} + Blnc;" 

The biological language in quotation marks is, of course, merely motiva- 
tional: it is just as easy to imagine all the players existing forever, but with 
nonnull moves only in the periods we have called their lives. 

Trade with the unborn and dead being impossible, we allow player ¢ to 
choose an amount y;-; to give to player (t — 1) at period ¢ and to receive an 
amount from player (¢ + 1) at period (¢ + 1). Each player also chooses a 
consumption amount at the end of each period, subject to the constraints 


G = pe (12) 
an — | as yt af Foe) Wee et | 
t — (a V1 C, - (13) 


Barter is entirely unpromising in this world, because there is nothing that 
player (¢ — 1) can give to player ¢ that player ¢ does not have already. 
Without money there will be no trade. Let player 1, therefore, receive m}' 
in money from player (¢ — 1) at period 1, and choose m},; to give to player 
(1 + 1) at period (t + 1). We take m} to be the exogenously fixed amount of 
paper money that player | has on hand when the game begins and require, 
as a technological constraint, that money outlays do not exceed money 
income: 


Moe =n eS ee (14) 


We will look at both price and naked trade commitment patterns for this 
game. First, price: 


£1) Maal (1G) Dea i 218 2 (15a) 
t = 2,3, 
ori pb oe. = mi (15b) 
=0 otherwise 


gch=AC) if pyt < mi). (15¢) 
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Let us consider some necessary conditions for a situation to be acceptable 
to player r > 1. Since we will be using supergoodness to find equilibria we 
need not search for sufficiency. From the price commitment pattern, and the 
uselessness of excess donations, a situation will be acceptable to 7 only if 


Oe (16) 

Pa! on 7 > a7) 
For t = 1, we have only the analogue of (17) 

By, 2m; (18) 


To be precise, we should have specified y’*! and y? as functions of pre- 
vious variables, since they will differ on different information sets for players 
(rt + 1) and 2 respectively. As we saw in the previous example, however, 
these distinctions will disappear when we look for supergoodness; so there 
is no sense loading up on notation that we will just throw away. 

Consider now the supergoodness problem for a player rt > |. The good- 
ness problem has an infinity of constraints, but we will ignore all of these 
except the technological constraints (13) for ¢ and (14) for 7 S ¢, and the 
acceptability constraints (16) for 7 = 4 + | and (17) for 7 =¢ — 1. Thus the 
supergoodness problem is 


1 
max a ine, a i6ilnic; »,, sit. 
Cage eoeigvin 
mils <rtl 
Ltt] pat 1+] 1 
Ca Va Vy | (13) 
u — t-1 
Pes = Mm, (14) 
=I 
iD Se Vint (14') 
(sol Ak t 
EM Vie tlc (16) 
=t yt > 1-1 
ID Vir) Za uy (17) 


It is easy to show from Lagrangian expressions that (17) must be binding 
if trade takes place. We know that for a situation to be acceptable to 1: 
P' yi. = m{! which hence is a necessary condition for an NE. But (17) 
binding means that in any supergood situation for ¢ and hence in any 
intersection of supergood sets p' y;-, = m/'. Since equilibrium situations 
are the intersection of all supergood sets and the set of NEs, this particular 
supergoodness approach will yield an equilibrium situation with trade only 
if p' = p' which we shall henceforth assume to be the case. 
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It should also be clear that (13) and (14) will be binding. Substituting 
(13), (14), (16), and (17) in the maximand, the problem becomes 


x P 


Bees fe 1 
max alnc; + Bln (I — cf + mz" = = = ) ; ae 
ot MA ill P 
mi = Vee (14') 
Once again, there are three cases to consider: 


(t-A) If (1/p"') — (1/p') > 0, then m!" should be as large as possible. 
Then (14') will be binding for all tr < 4 and hence m!' = m)!. The full 
solution becomes 


cs =a(I +m} areal 
ci! = B(L + mi Ea | 


1 
, 
Ji = i 





(t-B) If(1/p'') —(1/p') =0, then any value of m!"' is a solution; hence 
any weakly monotonically decreasing sequence 


0 1 2 
m,, M2, 1M3,...,M, 1 >, 


is a solution and 





f= + 
Cc =a cc =8 
1-1 1-1 
yf —_ iL pence, 
Vi-1 = 1 Jt a 1+] 
P P 


is the full solution. 


(t-C) If (1/p‘') — (1/p') <0 then m/' = 0, and any weakly mono- 
tonically decreasing sequence m!, m}, m3, ..., mj, will be a solution. 
The rest of the solution is: 


= Le 
c =a c 6 =B 
,f at 
vir — Vy = 0. 


In addition, the solution implies m!' = 0 for 7 > 1. 
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For t = 1, the supergoodness problem is 


max alin ci + Blinc; st. 


ei ee Le | 
Cys Cys Vis M2 


e<ity-c¢ (13-1) 
m, Sm (14-1) 
pe — 5. (16-2) 


By the same sort of arguments as before, all these constraints will be 
binding, and the solution will be 


co =a(1 + mi/p?) m= mi 
Die 0 2 Dee 0 2 

eo =B(IL + m/p) yi =m lp. 

Now we consider whether these supergood sets have an intersection— 
the question of agreement. First consider agreement between players | and 
2. Since in the supergood set for player 1, m, = m{ > 0, case C cannot 
obtain for player 2. Thus a necessary condition for a nonempty intersection 


of the supergood sets is that either case A or case B obtain for player 2; that 
is: 


(1/p*) — (/p’) 2 0. (19) 
If (19) holds, the intersection of the supergood sets of players | and 2 is 
characterized by: 

a — 1, 

yy, = m\/p° 

y2 =m\/p 
and the associated amounts of consumption. 

Agreement among players 1, 2 and 3 then requires that either case A or 
case B obtain for player 3, since agreement between player | and 2 requires 


m; =m > 0. Thus a necessary condition is 1 /p* — 1/p* = 0. Combining 
this with (19): 


ipa lip = \/p . (20) 


If (20) holds the intersection of the first three players’ supergood sets is 
characterized by: 

ns, 

yj =m\/p’, y2 =mi/p’, y3 = mi /p° 
and the associated amounts of consumption. Note that (20) requires 


i SoS. 
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It is easy to see that we can continue in this fashion indefinitely. If we do, 
the necessary condition for all the supergood sets to have an intersection is 


Up? = 1p a1 Ss aS = 
or 
Pp wi >2 (21) 


and that intersection is characterized by 


m =m Wa? (22a) 
yi: =a pr MES? (22b) 
VA =o vi > 2. (22c) 


This intersection is an equilibrium iff it is an NE. We used all the con- 
straints that characterize an NE in developing this intersection except (12) 
and (12-1) hence we know without checking that the intersection is an NE 
iff (12) and (12-1) are satisfied. Are they? 

First let us check (12): 


c} 1) or a(l +(m{/p’)) <1 (12-1) 
1.€., 
p> = a(m}/B). (23-1) 


So (23-1) is a necessary condition for this supergoodness approach to yield 
the equilibrium we are considering. Similarly for 1 => 2 


f 
Fa ee = 1 (12) 


rel — 


An at 
Pp 


Ta 
m, 


From (21) we have 
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l B 
Bo ern 
or 
0 
Hs mM, 
B 


t, while 
or 


is a necessary condition. By similar reasoning for (¢ — 1), 


0 
t m, 
P= 


B 


is a sufficient condition for (12) to be satisfied for (t — 1). Hence 


m 
t 
De ae Vt >2 
B 


is necessary and sufficient for (12) and (12-1) to be satisfied. 
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(23) 


By (21), then, (p’, p*,...,p’,...) isa weakly monotonically decreasing 
series. By (23), it is bounded from below. The Bolzano- Weierstrass Theorem 
states that a bounded monotonic series must converge. Hence (p‘) must 


converge; 1.e.: 


By Cauchy’s Theorem 
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ee oe | 


since (p'p’ ) is bounded away from zero by (23). It follows that 


lim ci =a 


as 


lim ci"! = B. 

a 
Thus in the long run, people are no better off than self-sufficient. In the 
short run, however, (that is, for small ¢) money and trade can make some 
players better off. Player | is sure to benefit if, through (15c), he can pretend 
that he is unwilling to part with something— paper money—which in fact 
is absolutely worthless. But after him such advantages become problematic 
and eventually must disappear. 

The equilibrium with a naked trade commitment pattern is in many 
respects similar. Such a commitment pattern would be 


gi) = AC) if m, >0 and yi <Fi 
orif yj [Rr and m, # my} 
=0 otherwise 
a(-) = fC) if yia<ji. and mi’ Smee 
orif mi, >0 and yl <p" 
orif min 4m, and ys" =e 
=0 otherwise, for t => 2. 


Single bar and double bar variables are parameters of the commitment 
pattern; double bar variables appear only in enforcement constraints. 

Necessary conditions for a commitment pattern of this type to be asso- 
ciated with an equilibrium with trade are: 


iO (Wr) 
nm = (Wt => 2) 
Fra = Fi (Wr > 2) 
Miss > mis (Vr) 


0 i} po) ST | 
m, = sup (m, ,m, ) 


Sat ie ae Ne (24) 


SIMPLE ECONOMIES WITH TIME 103 


If these conditions hold, an equilibrium is given by 


ca ik = 

Vr = Vin =i (vt => 2) 

l = 
Min = Min) (vz) 
m >m>m> SS pale >m!>m! > =f) 

| Sy 5 So SS SE te Br (A) (25) 
Dern = int (77...) > 0: 

t 


From (25) (i+: ) is a weakly monotonically decreasing series bounded from 
below by m*. By the Bolzano-Weierstrass Theorem it must converge to 
some m* with 


t+] 


By (25), similarly, (y;"') must converge to p* < B. By Cauchy’s Theorem, 


then, (y;"' — yi-1) must converge to zero. Thus, as in the price commitment 


pattern case: 


imc, = lima(l—y,, + yi") =e 
[—-° 1-0 
imc; — lim@(l — y+ y;!)=B 
ie) ies 


so that in the limit people are no better off than self-sufficient. 
Now define zr‘ as the variable that would look like price to an outside 
observer who did not know how the players in fact bargained: 


1-1 
1 a MN, 


t 
Vi-1 
Then from (24) and (25), ( ’) must be monotonically decreasing, since y;_; 


ii 


is increasing and m} ' is decreasing. Recall that (p') was also monotonically 
decreasing in the price commitment pattern. ( 77’) is bounded from below by 
(m*/j>*); thus by the Bolzano-Weierstrass Theorem it converges to 7* 
with 
Bee ey 
| 2 aaa a 
The “prices” that the observer would see in the naked trade case are uni- 
formly not higher than those he or she would see in the true price case, but 
they would behave in the same way. Since the observer would generally not 
have independent information on the value of B (which is, after all, a utility 
function parameter) he or she would be unable to tell by looking at actual 
behavior what type of commitment pattern was being used. 
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Our ability to deal with time makes it possible now to discuss economies 
with production, and the most interesting production economies are those 
in which trade must be roundabout. Leijonhufvud in particular has empha- 
sized the significance of roundaboutness in a production economy: “The 
individual steel producer cannot pay a newly-hired worker by handing over 
to him his physical product (nor will the worker try to feed his family on a 
ton-and-a-half of cold-rolled sheet a week)” (1968, p. 90). For this reason 
we will refer to the model in this section as the “L-economy.” We will 
consider two types of commitment patterns. First we will use a standard 
price system—and end up, of course, with the Walrasian equilibrium. Then 
we will modify this price system slightly to allow a bit of prudential ration- 
ing; an equilibrium with involuntary employment will result. 

Since in this section money will not be our primary concern, our treat- 
ment of it will be opportunistic and somewhat schizoid. Since we have 
only finite time paper money cannot be used. It is much more convenient, 
though, to include expenditure constraints as technology rather than as 
conditionals in commitments— but if we do so without money at the be- 
ginning trade will be impossible. Our escape from this dilemma is to use 
checking accounts which must balance only at the end of the game, and to 
consider the balance constraints as technological. This approach does not 
particularly make sense; it is harmless, though, and convenient. 

In the L-economy, then, there are four players, two workers and two 
employers, and two goods, x and y. Those who make x like to consume y 
and those who make y like to consume x. We will take the game to consist 
of two stages. At stage 1, the workers, players 1 and 2, choose amounts of 
labor /, and /, respectively, subject to 


hal (26) 
fs (27) 


and the employers, players 3 and 4, choose money payments m} and m3}, 
respectively, to workers | and 2, respectively. We may imagine production 
as taking place at stage 1, with player 1’s labor combining with player 3’s 
existing capital to produce good y, and player 2’s labor combining with 
player 4’s existing capital to produce good x. 

Distribution, trade, and consumption take place at stage 2. Players | and 
2 choose payments m} and m3, respectively, to players 4 and 3, respec- 
tively, subject to 


m, sm} (28) 
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m, =m). (29) 


Player 3 chooses amounts y; and y, of good y to give to players 2 and 4, 
respectively, subject to 


ea hh eli (30) 
and also chooses payment mj to player 4 subject to 
m, + mi =m; +m}. (31) 


Similarly player 4 chooses amounts x{ and x3 of good x to give to players 
1 and 3, respectively, subject to: 


ges ab = ll (32) 
and also chooses payment m3 to player 3 subject to: 
m, +m; Sm), + mi. (33) 


Players | and 2 have Cobb-Douglas utility functions in consumption and 
leisure, while players 3 and 4 care only about consumption: 


Inu, =alnx; + Bin(1 —/,) 
Inu, =alny3; + Bin(1 —/,) 
u, = ¢; (;) 
Di ee ae (v3) 
where €, and ¢, are arbitrary monotonically increasing functions. 
For any technologically feasible situation we have, from (33), (28), (31), 
and (29) 


4 4 1 3 3 2 4 4 4 
m, +m; =m,+m, Sm, +m <=m;+m3 smi +m} 


so that equality holds at every point in the above expression, as well as (33), 
(28), (31), and (29). Thus we may write 


a5 Sieh 
ms, —m, =™M, 


7 =e a 
m, +m, =m, +m, =m+m=m,+m 2m 
m; =m—m, 
m, —~m—™m, 


at any feasible situation and ignore (33), (28), (31) and (29). 
Let us consider a standard price commitment pattern: 


Sa hi) if wi<m or if Py * <m (34a) 
0 otherwise 
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ecy=Ac) if wmh<m, or if p: 3 <m, (34b) 
= 0 otherwise 
ac)=fhC) if p’y, Am or if p’ yg Am—m, (340) 
orif p3x3; <m—m, (34d) 
orif w,4<m, (34e) 
=0 otherwise 
g(') = fi) if p*xi #m, orif p’x; Am—m, (34f) 
orif psy, <m—m, (348) 
orif w,.h<m, (34h) 
= 0 otherwise. 


Note that in (34c) and (34f) we force employers to sell output at the 
same price to all buyers. This again is laziness, for an equal price is what 
would result from arbitrage if we permitted another stage at which a second 
round of trading could take place. Rather than complicate the problem 
with an arbitrage stage, we have merely grafted onto it the result that that 
stage would produce. Without either an equal selling price assumption or 
an arbitrage stage, the problem would be one of four goods with joint 
production —not the simple two-good problem we wish to consider. We do 
not, however, require that different buyers commit themselves to the same 
buying price. 

We may find the expressions characterizing acceptable situations in the 
usual manner. For player 1, acceptable situations must satisfy: 


Why hy ey (35) 

wil, = m,. (36) 
Similarly for player 2: 

m, <pays (37) 

w, 1, = m). (38) 


For players 3 and 4, since nothing that they do affects their own utilities 
directly, any situation in which they do not violate their commitments is 
acceptable. Thus in acceptable situations for player 3: 


py; =m, (39) 


py, =m—-m (40) 
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m—m, Sp3x3 (41) 
w,1, 2m, (42) 


and in acceptable situations for player 4: 


p x, =m (43) 
2s, =m — m, (44) 
m—m, = Ppiys (45) 
w,l, =m). (46) 


Situations that satisfy acceptability conditions (35)—(46) and feasibility 
conditions (26), (27), (30), and (32) are NEs. 

The good situations for player 1 are those that maximize his utility sub- 
ject to the feasibility conditions and acceptability conditions (37)—(46). We 
will follow an essentially (though not entirely) Walrasian supergoodness 
approach and ignore all these constraints except for (38), (40), (42), and 
(43). Hence the supergoodness problem for player | is: 


max alnx; + Bln(1 —/,) s+. 
(all variables) 


Ww, hb = m, (38) 
py =m—m (40) 
wl, 2m, (42) 
p’x; =m. (43) 


It is easy to see that (42) will be binding. Substituting (42) into (43), solving 
for xiand substituting in the maximand, we have 


max aln((w,/,)/(p*)) + Bln(l — 1) s.t. 


1,4,m, 
W, l= m, (38) 
py, =m —m). (40) 


Hence player 1’s supergood set has: 


w,l, =m, (38) 
Wa =m, (47) 
lL =a (48) 
x; = aw, /p" (49) 


1D YR Ue ao (40) 
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By following a similar approach we can derive player 2’s supergood set: 


w,/, =m, (36) 

W,a = Mm, (50) 

L —7y (51) 

y) =aw2/p (52) 
Weer Wea 

px; —m~— mM,. (44) 


Comparing (38) with (50) and (51), we see that the intersection of the two 
supergood sets will always be empty unless 


W2 = Wp. (53) 


Similarly, comparing (36) with (47) and (48), the intersection will be empty 
unless 


Ww, = Ww. (54) 
Since the supergoodness approach will yield an equilibrium only if the 
intersection of all supergood sets is nonempty, we will assume henceforth 
that (53) and (54) hold. 

For player 3 the goodness problem is to maximize x} subject to the 
feasibility conditions, (35)—(38), and (43)—(46). From (44) 

4 te my, 
ta) o> 
P 
Since p* is a parameter of the commitment pattern, the goodness problem 


may be taken as maximizing (m — m, ). By supergoodness we will ignore 
all constraints except (30), (36), (37), and (45). Thus player 3’s supergood- 
ness problem is: 


max ae ii >= m, St: 

MM, M2, Vy Vy Xp Xy 

rP+y<o, —YP 

Y2 Tg Sh Aly cy 
gente (36) 
okt ts (37) 
m—m, < pay. we 


Use (36) to substitute for m, in the maximand. (30), (37) and (45) imply: 


m m— mM, ; 
=~ +4+— ~<y typ Sh —-thh 
P2 Ps 
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Consider, then, the problem: 


Mo, M2 i 

m m— mM), 

SS SS SPS (30') 
P2 4 


First order conditions for a maximum include: 





ol x ol 
oo | + — = 0, m —— = () 
om Ds om 


Thus A < 0 is a necessary condition for a maximum. By complementary 
slackness, (30') is binding at a maximum. If (30!) is binding, then so must 
be (30), (37), and (45) in the previous maximization problem. If (37) and 
(45) are binding, then in every situation of player 3’s supergood set m, = 
pay2 and m — m, = py. But for every situation in player 2’s supergood 
set we have m, = py, (from (52) and (50)) and for every situation in 
player 1’s supergood set we have 


m—m, =p’ yi. (40) 
Thus the intersection of the three players’ supergood sets will be empty 
unless 


= 3 


P) =P; =P (55) 


which we henceforth assume. 
Substituting (55) in (30!) we find: 


My it => Late My) Mm Ty = m 
= (= ne i 


so player 3’s supergoodness problem finally becomes 


max m—w,l, s.t. 
m, | 


m 
ma a yet; (30!) 
p 


The solution to this problem is 


epee (56) 
Pp 


: 2 
m=pi(h —'bh)='bp ( -= ) (57) 
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Player 4’s supergoodness problem is symmetrical with player 3’s. Hence 
its solution is: 





£=1=-4 (58) 


my: 
m = p*(l, — hl) = p* ( (22) ). (59) 


We must now determine whether and under what conditions the four 
supergood sets will have a nonempty intersection. It will be sufficient to 
have agreement on /,, /,, and m, because it can be verified that agreement 
on these three variables will lead to agreement on all other variables. (The 
Walrasian analogue of this statement is that if the markets for both types of 
labor and one type of good clear, then the remaining market must clear by 
Walras’s law.) 

For /, then, agreement between players | and 3 implies that (48) and 
(56) must both hold: /, = a = 1 — (w, /p*) hence 


w/p =B (60) 
is a necessary condition for an equilibrium to exist with this supergoodness 
approach. Similarly for /, agreement between players 2 and 4 requires from 
(51) and (58) that: 

w,/p’ = B. (61) 
Finally, since by (48) and (51) /, =/, = a, agreement between players 3 
and 4 on m requires from (57) and (59) that: 


m=p(l, — bf) =p*(h — 83) 
or 





p’(a — ba’) = p*(a — ha’) 
that is: 

p =p’ =p (62) 
which implies in (60) and (61): 

Ww, = Ww, = Bp. (63) 


The necessary conditions for an equilibrium with the type of commitment 
pattern in (34), then, are the agreement-between-sellers-and-buyers condi- 
tions (53), (54), (55), and the analogue of (55) for player 4, and conditions 
(62) and (63), for any p > 0. It is easy to show that the situations in the 
intersection of the four supergood sets are NEs, because every NE con- 
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straint except (26) and (27) was used in developing them, and (26) and (27) 
hold. Thus we have found an equilibrium, and one that corresponds to 
Walrasian equilibrium. 

There is nothing sacred, however, about the purely price commitment 
pattern of (34). In many instances it is clearly not a very good representa- 
tion of how people bargain with each other. It would seem to represent well 
the process that occurs, for instance, when I go to a store, ask for two news- 
papers, and plunk down 4 dimes on the counter. For if I were to receive no 
newspapers or only one I would feel angry and cheated, and if I confronted 
the storekeeper with my dissatisfaction, the response would not be: 

“T will give you however many newspapers I please. These are my news- 
papers and I will do what I want with them. Thank you for your gift of 40 
cents.” 

But rather: 

“You can’t count. You only gave me 2 dimes. I gave you one newspaper. 
We're even. Get outtahere before I call the cops.” 

On the other hand, if I were to go to the same store, plunk down 4 
million dimes, and ask for 2 million newspapers, I do not expect that I 
would receive them either, but the dialogue would be qualitatively different. 
On ascertaining that it was in fact 4 million dimes I had plunked down on 
the counter and finding himself unable to supply me with 2 million news- 
papers, the storekeeper almost certainly would not thereupon commit hara- 
kiri in accordance with a price commitment pattern. He or she would not 
even, I suspect, show any remorse (pity, maybe, but not remorse). If I were 
to remonstrate, 

“Your sign says newspapers are 20 cents each. Here’s my 4 million dimes. 
You owe me 2 million newspapers,” the most kindly response I could expect 
would be: 

“The sign doesn’t mean what it says. What it means is newspapers are 20 
cents each until we run out.” 

In this manner we would learn that the storekeeper’s commitment is not 
in fact a bare price commitment, but rather a commitment that includes 
some quantity constraints. Similarly, if the storekeeper had put 2 million 
unrequested newspapers on my doorstep and asked for 4 million dimes, we 
would have learned that my commitment also included quantity constraints. 
Indeed, if quantity constraints by buyers are not the normal practice, why 
do people comment that medicine is odd because physicians as sellers do 
not consider themselves affected by quantity constraints? 

We should not think, then, that commitment patterns with quantity con- 
straints are in any sense weird or unusual. A commitment pattern is a 
commitment pattern, and a pure price commitment pattern is just a very 
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special type of commitment pattern—one which, in fact, as the newspaper 
store story suggests, is probably not very important empirically. Let us 
modify (34), then, to add some quantity constraints and thereby make it 
more realistic. 

There is no solid reason why we should not put quantity constraints on 
every line of (34). I do not know anyone who would commit herself to 
work 25 hours per day for the right amount of money or deliver an arbi- 
trarily large number of pizzas tonight for an arbitrarily large amount of 
money, but these are the sorts of commitments the L-economy players are 
making in (34). Nevertheless, putting quantity constraints on every line in 
(34) would make finding an equilibrium situation computationally difficult. 

So we will only put quantity constraints on the purchase of labor. We will 
do this by considering a new commitment pattern called (34') that is ex- 
actly like (34) except in the lines (34e) and (34h). We replace these lines by 


£:(-) = £06) if wyl<m, orif w, 1, <m, (34'e) 
and 
s)=fAAC) if mh<m orif wl<m (34'h) 


respectively. What (34'e) and (34'h) say is that employers will not pay for 
more than /,, i = 1, 2, “hours” of labor even if workers work more than that. 
One should not be surprised to see capitalists making such commitments, 
because they must decide on how much money to give workers in stage 1, 
before they have received any payments for products in stage 2. It is entirely 
reasonable to expect employers to want some control over how much they 
pay workers and how much is produced; commitment pattern (34) puts 
these determinations solely in the hands of labor, but (34') does not. Em- 
ployers in (34) say “Whoever shows up will be paid at a rate not to exceed 
W no matter how much work is done and how much output is produced,” 
while employers in (34!) say, “Whoever shows up will be paid at a rate not 
to exceed w but once /is done everyone can go home.” (34!) thus seems to 
correspond more closely to the type of commitments we see in actual labor 
markets: most employers determine the amount of work they want done, 
and will pay for no more than that amount. After all, if (34) were the case 
rather than (34! ), disgruntled employees would try to harm employers by 
working extravagant amounts of overtime, rather than by withholding labor. 

Let us see then what sort of equilibria result with commitment patterns 
like (34'). Acceptable situations for players | and 2 remain the same with 
(34!) as they were with (34). For player 3, (42) must be replaced by 


oN eae a Be ey? (64) 
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mim if | =], (65) 


so that player 3’s acceptable situations are characterized by (39), (40), (41), 
(64), and (65). Similarly for player 4, (46) must be replaced by 


mim if <b (66) 
rem if § =b (67) 


and player 4’s acceptable situations are characterized by (43), (44), (45). 
(66), and (67). 

The changes we must make in supergood sets are somewhat the opposite 
of the changes in acceptable sets. For players 3 and 4 the supergood sets 
will remain the same, since neither used either (42) or (46). For players | 
and 2, however, we must find new supergood sets. 

For player 1, we will maximize utility subject to (38), (40), (43), (64), 
and (65): 


max alin x; + Bin(1 —/,) st. 


ee 

wil, = m, (38) 
Dys SUL aay: (40) 
px, = mi; (43) 
mem tf £ <i, (64) 
Bieta Ly = hy. (65) 


First suppose that a < /,. Then we can solve in the same way we did 
before and obtain: 


W2l, = m, (38) 

py, =m—m, (40) 

aw, =m (47) 

l =a (48) 
eeyesean sy a 

x; =a(W¥,/p’) (49) 


for any situation in player 1’s supergood set, and (65) is obviously satisfied. 
If, on the other hand, a > /,, (65) becomes a problem. Then player 1’s 
supergood set is given by: 


wl = m, (38) 
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i ee 


Py mm (40) 
iw, =m (66) 
=|, (67) 
xi =1,(w,/p’). (68) 


Similarly, if a </,, player 2’s supergood set is characterized by: 


w,/, =m, (36) 
p’x; =m—m, (44) 
wa =m, (50) 
L=a (51) 
¥2 = (W,a)/p* (52) 
and if a > /,, it is characterized by: 
w,/, =m, (36) 
p’x; =m—m, (44) 
lw, =m, (69) 
i, =1, (70) 
y2 = 1(%/p’). (71) 


It is easy to verify that these supergood sets require for a nonempty 
intersection the usual equalities of selling and buying price, i.e., (53), (54), 
(55), and the analog of (55) for player 4. 

In looking for agreement, we realize that there are four different sub- 
families of the family of commitment patterns given by (34'). In each of 
these families there are different requirements for equilibrium. 

Subfamily 1. lf « <1, and a </, then the results are exactly the same as 
they were for the pure price commitment pattern (34). 

Subfamily 2. If a >1,, a </,, the quantity constraint is binding in the 
“market” for player 1’s labor. For agreement between players | and 3 on /,, 
(67) and (56) require: 7, = 1 —(w,/p*) or 


w,/p =1—h. (72) 


Since /, <a, (w,/p*), player I’s wage in terms of output, is greater than 8, 
its value under (34). 

The market for player 2’s labor in this case is unaffected by any quantity 
constraint, and so acts in the same way it did under (34) 
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L=a 
w,/p* = B. (73) 
Finally agreement between players 3 and 4 on m means: 
pa(l — 'ha) = p’h (1 — 'bh) 
or 


° es é 

P i (= 'bh) 

Tt = Tee 

P es) (74) 
From (74) we can substitute into (72) and (73) to find the prices and wages 
that are necessary for an equilibrium given any p’: 


rhe ‘hile hl) 3 3 
Barangay? <p (75) 
3 Sea) 3 
——— aaa SSS 6 
Ww, —' Bp ina) < Bp (76) 
w, = (1-1) p*® > Bp’. (77) 


The situations that are supergood for all players when the commitment 
pattern satisfies these conditions may easily be verified to be NEs, and 
hence we have an equilibrium. 

Let us spend some time comparing this unemployment equilibrium with 
the full employment equilibrium of (34) or subfamily 1. Notice first that we 
no longer have p* = p* and w, = wy, despite the fact that technology and 
demand in both sectors remain identical. An immediate consequence is that 
we lose the equality between the “production real wage,” w, /p° or w,/p* 
and the “consumption real wage,” w, /p* or w,/p°. Thus if we talk about 
“real wages” we must specify whether we are talking about wages relative 
to the price of the good being produced or wages relative to the price of 
the good being consumed. This distinction between wage in terms of prod- 
uct and wage in terms of consumption, it should be noted, is crucial to 
Keynes’s definition of involuntary unemployment in the second chapter of 
the General Theory (1936). Readers familiar with that chapter will also 
note that what Keynes called the first and second postulates of the classical 
theory survive this model in precisely the manner he predicted. The first 
postulate—the equality of wage and marginal product—is always valid, 
while the second postulate—the equality of wage and marginal disutility of 
labor—holds only with full employment. 

These distinctions are quite helpful in assessing whether players are bet- 
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ter off in this subfamily or in the full employment equilibrium. Since player 
2’s hours of labor are the same in either case, player 2 is better off or worse 
off according as his real wage in terms of consumption, w,/p’ is greater or 
lesser. Now 


WwW W> 


3 
Pp Pp 








So that player 2 is worse off in the unemployment equilibrium, since his 
real wage in terms of product, w, /p*, is the same in both subfamilies, while 
from (74) 

p*/p? <1 
when there is unemployment, but by (62), p* = p* when there is not. 

For player | we must consider both the change in the real wage in terms 
of consumption and the change in the amount of labor. Player I’s real wage 
in terms of consumption increases with unemployment, since 

w Wp 7, P 

Oe Mea ee i Saat) 

Pp P P P 
and | —/, >1 —q@and p’/p* > 1. (Cf. Keynes’s discussion in the General 
Theory, chapter 2, section V.) On the other hand, consumption ¥; might 
be reduced because hours of work are less with unemployment. But the 
increase in the real wage in terms of consumption turns out to be more 
important. 


a(l—'ho) _. 3) 
0-4) 


Lwe=%) 


x 


where af is the value of x} under full employment. The second effect of 
reduced work is increased leisure, which increases player I|’s utility. Since 
both arguments of his utility function, consumption and leisure, are greater 
with unemployment than with full employment, player | is better off in the 
unemployment equilibrium. It follows almost immediately that player 3 is 
worse off in the unemployment equilibrium. This is because player 3’s utility 
is proportional to x}, the difference between total output of x and x}. The 
output of x is not affected by unemployment in this case, while we have just 
seen that x} increases. Thus x} decreases. 

How can we say that the unemployment case is an equilibrium when the 
player who “causes” it, player 3, becomes worse off? Because he cannot find 
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any actions or commitments that will make him better off, given the actions 
and commitments of the other players. Does not the existence of a com- 
mitment pattern like (34) that appears to differ from (34!) only for player 3 
belie this claim? No, since (34) or (34', subfamily 1) only appear to be the 
same as (34!, subfamily 2) for the other players. In fact, for the versions of 
these commitment patterns for which equilibria exist, the parameters differ 
in the different cases, so that the other players are making different com- 
mitments, even if those commitments have the same form. If players 1, 2, 3 
are making commitments with p*, w,, and w, given by (75), (76), and (77), 
then player 3 can do no better than to ration employment. It is by no means 
contradictory, surprising or even interesting that if they were making other 
commitments —e.g., those given by (62) and (63), and (34)—-player 3 could 
be better off. (Similarly our conclusion that player | is better off at the un- 
employment equilibrium than at the full employment equilibrium does not 
imply that unemployment is good for workers. Player | would be even bet- 
ter off if the other players’ commitments satisfied (75), (76), and (77) and 
there were no quantity constraint, but this would not be an equilibrium.) 

Finally, we can also show that player 4 is worse off in the unemployment 
equilibrium. In the full employment equilibrium we had: 


ya =(1/p’)(m — wrh) = a(1 — ha) — aB 


with unemployment we now have: 





4 4 
mp Ww, 
ae =n wh) oe ty. Fe 
Pp P P P Pp 
Pp m Dp 
=; |— — oB) = GS (a! — ka) —a@B) < a(1 —'ha) — oB 
po \p P 


so player 4 is worse off. 

Subfamily 3. If a >1,, « <1,, we have a problem that is exactly sym- 
metrical with that of case 2. Player 2 will be better off than in the full 
employment equilibrium, and players 1, 3, and 4 will be worse off. 

Subfamily 4. If a >1,, a > 1,, we have unemployment in both sectors. 
By our usual method, necessary conditions for an equilibrium to exist in 
this case are: 


1 = vA) 3 
(= th 1) ¥ 
w, =(1—-h) p 
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and if these conditions are fulfilled it is easy to verify that with the corre- 
sponding NE there is an equilibrium. 

This equilibrium is a combination of the equilibria of subfamilies 2 and 
3. Players 3 and 4 are worse off in both subfamilies 2 and 3 than they were 
in subfamily 1; they are also worse off in subfamily 4 than they were in 
subfamily 1. For players | and 2 the comparison is not so easy. 

We will deal with player 1; symmetry will extend the results to player 2. 
If /, is quite close to a and /, is quite far from a, then we will be quite close 
to subfamily 2 and player | will be better off than in the full employment 
equilibrium. Similarly if /, is quite far from @ and /, is quite close to it, 
player | will be worse off. 

But what if we are somewhere in the middle between subfamilies 2 and 
3? To make matters simple let us consider what happens at the exact middle: 


L =f le (78) 
When there is no unemployment, player 1’s utility is 
Inu, =alnaB + BlnB =alna + InB. 


When (78) obtains we have: 


z (l-—D)pl a+ 
Inu, = aln Td") . io) 3 + Bin(l — /) 
1(i— 'pl) 


= aln(1 —/)/+ Bln(1 —/) 


ala? In(l = i) 
We will call this last expression /(/): 
h() = aln/ + In(l — 7). 


The question can then be phrased as: for what (if any) I<aish(1)>h(a)? 
Obviously such a question calls for an examination of the shape of /(-). 
This function is twice continuously differentiable on [0, |] with 


The only stationary point occurs at / = a/(1 + a) since h’ [a/(1 + a)] =0. 
This is a maximum because 


h’[a/(1 + a)] =(1 +a)’ [C1 — (1/a)] <0. 
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Since a/(1 + a) <a, hA(-) is decreasing in the interval (a@/(1 + @), aw). Thus 
if a/(1 + a) <I <a, h(/) > h(a), and player | is better off under (78) 
than under the full employment equilibrium. If /< a/(1 + a), the matter is 
not clear-cut. If /is in the upper part of this range, h(/) > h(a), but if / is 
close to zero, the opposite is true. There is no explicit expression for the 
dividing line. Player 1, then, will be better off under (78) than under the full 
employment equilibrium unless unemployment is rather substantial. 

Thus we see that in three of the four possible kinds of equilibrium with 
(34!) there is involuntary unemployment. The key question is then what 
determines which type of equilibrium will prevail. The answer is simple: 
nothing. An unemployment equilibrium is every bit as much an equilibrium 
as a full employment equilibrium; no equilibrium is any better than any 
other; every equilibrium is consistent with the technology and the utility 
functions. 

The commitment pattern (34!) has essentially six parameters: w,, w>, 
p’, p’, |, and /,. Necessary conditions for an equilibrium (e.g., (75), (76), 
(77) or (62), (63)) are three equalities. Hence a commitment pattern for 
which there is an equilibrium has three undetermined, “free” parameters. 
Based on our motivational discussion of how employers operate, and con- 
venience, we have taken the free parameters to be p’, /,, and /,. Often 
economists take w,, w,, and p’ to be free and proceed to talk about “sticky 
wages.” It does not matter: free parameters are free, and equilibrium is 
equilibrium. Some triplets of free parameters are associated with full em- 
ployment equilibria, and some are associated with unemployment equi- 
libria, but every (positive) triplet of free parameters is associated with some 
equilibrium, and hence no triplet is any better or any more special than any 
other. Unemployment equilibria are neither fictions nor anomalies. 

These findings, of course, are in many ways derivative from the “macro- 
economic disequilibrium” tradition of Clower (1965), Leijonhufvud (1968), 
Dréze (1975), Benassy (1975), and Malinvaud (1977), inter alia (surveyed in 
Drazen [1980]). This tradition, however, has been criticized for not giving 
a convincing explanation for its fundamental assumption: that agents will 
at times pass up transactions that yield Pareto improvements. Game theory 
provides a very quick and satisfying explanation: just as we saw in prisoners’ 
dilemma, there exist commitment patterns with which there are equilibria 
only in unattractive situations. 


IV 


Unemployment equilibria cannot exist unless labor market commitments 
include quantity constraints, but when they do we can use quantity con- 
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straints in the output market as well to illustrate the role of “aggregate 
demand.” 

To be definite, consider a commitment pattern (34'' ) that differs from 
(34!) in that /, > aso that player | is fully employed at equilibrium, and in 
that (34'a) and (34'd) are replaced by 


BC) arc if wi<m (34''a) 
orif pix,<m, 
ort pi; x4 
and 
BC)=hO) if p3ax3<m—m (34""d) 


: -4 4 
Orif psx; <m —™m, 


respectively. Also, let player 4 charge different prices to players | and 3. In 
the new commitment pattern, player | refuses to pay for more than <} of 
good x, and player 3 refuses to pay for more than <} of it. We can imagine 
that players | and 3 believe that their incomes will not permit them to 
purchase more than these amounts, and do not want to go into debt, or 
cannot do so. 

If we assume that 

5 che eee aah eae 


then an equilibrium will exist with (34!') iff: 


P, = (aBp’)/(*)) 
B=w,/p 

Ww, <p, — x, ea 
We <p Gh a aaah: 


for some positive p’. 

How accurate, then, will be the fears of players | and 3 that they will not 
be able to afford more than *} and ¥} respectively? Completely accurate, 
no matter what the level of aggregate demand (*} + X}). For, substituting 
from the equilibrium values, we find that player I’s income, w, /,, will 
always equal p} <}, and player 3’s income, m — m,, will always equal p} 3. 

This is the sort of equilibrium that Malinvaud (1977) deals with at length, 
and what lies behind the IS analysis and Keynesian cross of standard macro- 
economics. Notice in particular that reducing w, has no effect on employ- 
ment: “sticky wages” cannot be singled out as “the cause” of unemployment. 


8 = Multitudes 


A people is but the attempt of many 

To rise to the completer life of one; 

And those who live as models for the mass 
Are singly of more value than they all. 


ROBERT BROWNING, Luria, act 5. 


The best known result of game theoretic investigations of economics has 
been that the core converges to the Walrasian equilibrium allocation as the 
number of agents in the economy becomes very large. Edgeworth (1881) 
first argued that this was the case, and his work was brought to the attention 
of a modern audience and translated into modern terminology by Shubik 
(1959). Edgeworth dealt with an exchange economy with two goods and 
two types of agents which grew large by replication. Debreu (1962) gen- 
eralized this result to the case of a finite number of commodities and types, 
while Debreu and Scarf (1963) simplified Debreu’s proof and added the 
possibility of production. A different approach was taken by Nishino (1970), 
Hildenbrand (1970) and Arrow and Hahn (1971, ch. 8), who consider a 
sequence of economies with successively greater numbers of participants. 
Aumann (1964), on the other hand, showed the equivalence of the core and 
the Walrasian equilibrium in economies where agents are plentiful enough to 
form a continuum; Hildenbrand (1974) and others elaborated on Aumann’s 
finding. Finally, Aumann and Shapley (1974), showed that value is also 
equivalent to Walrasian equilibrium in economies with a continuum of 
agents. 

The obvious question, then, is whether the non- Walrasian results we have 
found in the last two chapters will similarly disappear when we consider 
large economies. Large economy questions are also important in their own 
right, since most real economies have more agents than you can count on 
your fingers and toes. This chapter will look briefly at the large economy 
question, and find that the answer is no. The non-Walrasian results are ro- 
bust. Commitment equilibrium is built on noncooperative (bellum omnium 
contra omnes) game theory in which it does not fundamentally matter to 
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a player the number of the omnes against which he is warring. Unlike 
solution concepts based on effortless, all-encompassing, mysterious, and 
magical coalition formation, commitment equilibrium does not degenerate 
in the presence of large numbers. 

This does not mean, of course, that large games do not provide new and 
interesting phenomena to be studied with commitment equilibrium, or that 
a properly detailed study of the relationship of Robinson Crusoe and Friday 
can tell us all that we need to know about how the world economy will 
evolve over the next fifty years or what the price of green neckties will be in 
Philadelphia in June 1997. Some of these new phenomena, especially in the 
labor market, are examined in the latter part of this chapter. 


I 


Let us quickly put to rest any suspicion that commitment equilibrium 
necessarily converges to Walrasianism with a very simple counterexample. 
Recall from chapter 6 the two-person, two-good economy —the one whose 
possibilities could be summarized so easily with an Edgeworth box. We 
showed there that the only commitment equilibrium with a price commit- 
ment pattern coincided with Walrasian equilibrium, but that any point at 
all in the Edgeworth box could be associated with a commitment equilib- 
rium with a naked trade commitment pattern. (When endowment was not 
a corner of the Edgeworth box, this was revised to state that any point 
weakly Pareto-superior to the endowment point could be associated with a 
commitment equilibrium.) 

Now let us see what happens when we expand this economy to a size of 
2n agents, where we allow n to be arbitrarily large. Let n of these agents 
be type | agents, with an endowment of one unit of the first good and none 
of the second; we denote these type | agents by i = 1, 2,...,n. The other 
n agents will be type 2 agents, with an endowment of zero units of the 
first good and one unit of the second; we will denote these type 2 agents by 
j =1,2,...,n. As before, a type | agent’s utility will be given by 


Inu; = aln(1 — Da) + Blin >» 
j j 


where x; denotes the amount of the first good that type | agent / gives 
type 2 agent j and y/ the amount of the second good that type 2 agent / 
gives to type | agent /. Similarly a type 2 agent’s utility is 


Inu; = aln> x} + Bin(1 — > y?). 
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Thus a strategy for a type | player i is an n-vector (x}); j=1,...,n with 
Bx = 1; 
j 

and a strategy for player 2 is an n-vector (y/), i= 1,..., with 
Py, = 1. 


This game is the n-fold replica of the game we studied in chapter 6. 
Now consider the following naked trade commitment pattern: 


For all i, g;,(-) = fi(-) if % <x) ‘and y! =7G) for.g =i @ 
= 0 otherwise. 

For all j, ¢,(-) =f,(-) if x; = (i) and y] <p(i) for i=j 
= 0 otherwise. 


It is quite easy to verify that for any 2n-vector (X(i), #(i)), all of whose 
elements are strictly between 0 and 1, g is a commitment equilibrium with 
the following situation: 


Type | player 7 gives X(7) to the type 2 player j for whom (2) 
j =i, and nothing to any other player. 


Type 2 player j gives (i) to the type | player 7 for whom 
i =/j, and nothing to any other player. 


This holds for any n, and thus there is no tendency for convergence to the 
Walrasian equilibrium, either individually or in the aggregate. 

Nor would modifying the game to allow an additional “arbitrage stage” 
for trading change this result. (1) would still be a commitment pattern in 
the modified game, with no commitments whatsoever being made about 
“arbitrage stage” moves. Then (2), with the additional proviso that no trade 
take place at the arbitrage stage, would be a commitment equilibrium with 
(1). There would still be no convergence. 


II 


Other phenomena far more interesting than convergence to Walrasian equi- 
librium occur with large economies. For instance, let us see what happens in 
the labor market of the L-economy when the number of workers increases. 

Recall that in the L-economy of chapter 7 players | and 2 were workers, 
and players 3 and 4 employers. Player 1’s labor was sold to player 3 to 
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produce good x; player 2’s to player 4 to produce good y. Player | con- 
sumed leisure and good y; player 2 consumed leisure and good x. 

Now let there be n clones of player | called (1,1), (1,2),...,(1,i),..., 
(1,n), and n clones of player 2 called (2,1), (2,2),...,(2,i),...,(2,n). 
There are no clones of player 3 or player 4, but production functions have 
been changed to accommodate the possibility of additional labor (the pro- 
duction function of chapter 7 decreases when labor is greater than unity): 


I 
xa + Ya) S DAO — 5 (LAW) (3) 
4 47: A l eh 
Yr DO) = = L@) — eve (X40) (4) 


where x3(i) denotes the amount of good x that player 3 gives player (2, /), 
y}(i) the amount of good y that player 4 gives player (1, i), /, (7) the amount 
of labor that player (1,7) supplies, and /,(/) the amount of labor that player 
(2,7) supplies. Monetary constraints are, for player (1, /), 


mii) = mii), i= 1,...,0 (5) 
for player (2, /) 

ma) Sas a ae (6) 
for player 3: 

my +X mili) SY mii) + mj (7) 
and for player 4 

m, + po m3(i) < Dy m\(i) + m3 (8) 


where the notation should be self-explanatory. By the same argument we 
used in chapter 7 inequalities (5)—(8) imply that at any (feasible) situation: 


m=m, + > mi(i) = > m3(i) +m; =m; + ¥ mii) 
=X mii) + mi 


m(i) = m4(i) = m4(i) 


~ 
bons 
. 
. 
= 


lI 
| 


m,(i) = m3(i) = mii) 
mi =m — > m (i) 


m; =m— ¥ m,(i). 
i 
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First let us try a commitment pattern like the ones we used in chapter 7: 


enc) — fr) if w (iA) < m, (i) (9a) 
orif pif) yi) < m(i) (9b) 
=0 otherwise 
Git) = fil) if w,(7)L (2) < m(7) (9c) 
or if p3(i) x3(i) < m(i) (94) 
= 0 otherwise 
eC) — fC) if m(i)4()<m(i) and A) SA) (ve) 
for any i 


orif w,(i)),(i) <m(i) and 4(i) >/1(i)_ (9f) 


for any i 
orif p x3(i)#m,(i) foranyi (9g) 
orif p xi Am > m,(i) (9h) 
orif psy; <<m— > m (i) (91) 
=0 otherwise 
EC) = SC) if (i) h(i) <m,(i) and h(i) Sh()) i) 
for any i 


orif wW,(i)L(i) <m,(i) and 1L(i) >4L(i) (9k) 


for any i 

orif p*yi(i)#m,(i) foranyi (gl) 

orif p'y; #Am— ym (i) (9m) 

orif pyxz<m— > m(i) (9n) 
= 0 otherwise. 


Equilibrium in this economy is essentially no different from equilibrium 
in the chapter 7 L-economy. Let 


N, = {i|h@ < B} 
N, = {i|L@ < B} 
n = | N, | 
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and 

ny = | N, | : 
Then necessary conditions for there to be an equilibrium associated with a 
commitment pattern like (9) are: 


w, (i) = W,(i) = w, {vi|/,(i) > 0} 
w,(i) = (i) Sw, {Wi (i) > 0} 
Pi(i) = p* {vi|71,(i) > 0} 
Pi) =p” {vi| (i) > 0} 

(n— n)B +X hi) — ‘hl — m8 + LOY 
A, Aes 1 1 
PSAP 

(n— m)B +X bi) ‘h(n — n2)B + % LOY 
wi = PEL (O/m)[in— mB + LLY 


= P {a + (I/n)[mB — X LOY 


W2 


P* {a + (I/n)[mB — 3 LOT 


pin: 
In the situation associated with any such commitment pattern 
Nese if i€N, 
L@) =a) Vi ren, 
L(i) = B if i¢ N, 
b@) =L0)  #OVEN 


and all acceptability constraints, as well as (3) and (4), are binding. 
A couple of extreme cases best illustrate how little change there is from 
chapter 7. First suppose 


N, =N, =9 


i.e., full employment. Then 
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La) =L,0 =B8B (Vi) 


just as in the full employment case. Indeed, it may be checked in (3) and (4) 
that output of each good is exactly n times as great as it was in the single 
worker economy, each worker consumes the same amount that his progeni- 
tor did in the single worker economy, and each capitalist’s consumption is 
times as great. 

Now let NV, = @, to simplify matters, and for all i € N, 


i(i) =0 


i.e., workers are either fully employed or fully (and involuntarily) unem- 
ployed; there is no involuntary part-time employment. If 


u=n,/n 


is the unemployment rate, we have 


p= \ Sot ou ev asa 
w, = (a + uB)p° 

3 Lgeitt 
WwW, = ap ! te ou mena 
p>0 


h(i) = B if i¢M 
1,(i) =0 iN, 
b(i) = B (vi). 


As in chapter 7, unemployment in the first labor market results in an equi- 
librium worse than the full employment one for player 2’s clones, player 3, 
and player 4. Employed clones of player | are better off, but unemployed 
clones are worse off. At any rate, equilibria with involuntary unemployment 
are just as possible with many workers as with only one. 


Ill 


Note that /,(i) = 0 means that player 3 is making no commitment what- 
soever to player (1,7) in (9). As a result, player (1,7) must end up unem- 
ployed in equilibrium. Cultural differences and communications problems 
can thus cause unemployment—if player 3 is unwilling or unable to make a 
commitment to (1,7), or vice versa, (1,7) will never go to work, no matter 
how low a wage he volunteers to accept. 
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IV 


Expanding the work force also lets us consider organized labor. After all, 
labor unions are not spectacularly interesting organizations when there is 
only one worker. 

Labor unions do not work in the context of pure price commitment 
patterns (since labor unions do exist this gives us another reason to suspect 
that not every commitment in the real world is purely price). Indeed, the 
standard explanation in economics for how unions work—workers get 
together and agree to withhold all their labor unless the employer agrees to 
increase all their wages—is faulty. 

To understand why this scenario fails, consider how a union organization 
of this kind would affect a typical worker’s commitment. For simplicity, we 
will consider only a union of player 1’s clones, and assume that all these 
clones have joined a union and have formulated a wage demand w, (/), i = 
1,...,0n which they have come to complete agreement. This means that 
the commitment (9a) must be modified to (9'a): 

m(j) 


fi) = Fi) if i >0 and (3/)”v,0) > (9'a) 
Lj) 


orif w,(i)),(i)<m,(i) and (W)w (J) Ss GU) 
and the rest of (9) remains the same. This change affects the constraints 
defining only one super-possible set, that of player 3, and what it does to 
those constraints does not affect the supergood set at all. With (9), the 
labor market constraints in player 3’s supergoodness problem were: 


(Wi) wi) 4) = m,(Z). (10) 
With (9!) they become 
(Vi) W@OAM =m) if (WH) m)AG) Sm) (11) 
(i) =0 otherwise. 


Clearly the only new addition to player 3’s super-possible set that (11) 
makes are those situations where /; (7) =0, for all i, and m,(i)> 0 for some i. 
Since these situations are by no means maximal for player 3 in his super- 
possible set, they are not supergood for him. Since no player’s supergood 
set changes, there is no change in the equilibrium situation. Labor unions 
like this cannot help their members. 
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A proper understanding of unions requires that we consider commitment 
patterns with quantities as well as prices. The simplest such commitment 
pattern is naked trade. Let player 3’s commitment then become: 


as) = AC) if mi) ¥ (i), (g''e) 
and /(i)=/(i)>0  foranyi 


OFif mG) 0 Vand EO=<1@ (9'"'f) 
for any i 


and nothing else changes from (9). Player 3’s commitment is thus a “take it 


or leave it,” “all or nothing” offer to each worker. Workers must “take it” 


since the alternative is starvation: 
1,(i) = 1,(i) 
m(t) = W, (i) 1, (i) 


in the supergood set of each worker (1,7). Equilibrium then requires: 





w(i) = w(t) = w, 
W,(7) = w,(i) = wy 
di (4)° 
p =p Yan BD 
nB (1 — 'hB) 
ie — ap 
: LA 
ieee oN ie = (11) 
n 
pe > 0 
h(i) = 1(i) 
BG) =-B 


where we have assumed full employment in the other sector of the economy. 
Notice that increasing (,/,(i)) hurts player 1’s clones twice: by increasing 
p’, the price they must pay for their consumption good, and by decreasing 
their wage w,. If /, (i) = 8, moreover, increasing /, (/) hurts player i directly 
by depriving him of leisure that he wants. The historical importance to the 
labor movement of the demand for a shorter work week leads one to sus- 
pect that employers’ commitments are in fact naked like those of (9''); the 
emphasis placed on this demand is hardly explicable in a Walrasian system. 
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Workers will not be able to improve their lot merely by switching to 
naked trade commitments. Individually, of course, no worker can improve 
his lot by changing his commitment —this is the definition of a commitment 
equilibrium. Nor can a coordinated movement to naked trade commitments 
help. On the contrary. For let (9''') be the same as (9'') except that for 
every i we revise (9a) to: 


guc)=fie) if mi)=w@hG and 4) >hG). (Ma) 


Then player 3’s supergoodness problem can be written (with the usual 
substitutions: 


3 
ae P ep are. 

mae pS L(i)e;— aA (> i,(i)e;)” = > w, (i) 1, (ie; (12) 
s.t. e; © {0, 1} for all 7. 

This is a quadratic combinatorial programming problem; player 3 either 
employs player (1, i) for /,(’) hours and pays him w, (i)/, (7) —in which case 
€; = 1—or does nothing at all with him—in which case e; = 0. 

Now whatever the solution to this problem there will be no agreement 
between player 3 and player (1,7) unless e; = 1, because /, (7) > 0 in player 
(1,7)’s supergood set. Thus a necessary condition for equilibrium is that a 
solution to problem (12) be €; = | for all i. This will be the case only if for 


every j= 1,...,nthe maximand in (12) does not decrease when e; changes 
from 0 to 1, holding e; = 1, for all i * /. That is, a necessary condition is 


3 
Pdi) - = (LAW)? — LmMiw 


i 


3 
29 Siw -Z¢Shwy? -¥ moho 


i¥j al] 


or, after suitable manipulation, 


Py DAG) 
l i 
wi(j) + iJ) <p te ss (vj). (13) 


Since 


hG)=hG) (Wi) 








is also clearly a necessary condition for equilibrium, we can compare (11) 
and (13) and see that worker (1,/)’s wage rate cannot exceed what it was 
when workers made price commitments, and the length of work is the 
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same. Although the minimum penalty in wages for using naked trade 
commitments 


(ij) 
2n 





vanishes when n — © , there is still no gain. It would be foolish for unions 
to act as coordinators of naked trade commitments. 

For unions to have some purpose, then, they must be able to make to the 
employer a single all-or-nothing naked trade offer, just as the employer 
makes a single all-or-nothing naked trade offer to each worker. If a union 
can do this, it creates essentially a bilateral naked trade commitment pat- 
tern, with which, as we have seen, any situation not Pareto-inferior to 
autarky is an equilibrium. The obvious candidate for the commitments 
needed to accomplish this end is (9*a), where it is assumed that all workers 
have agreed on the demand (w, (i), i,(i)), 1 = Joes olte 


ZiC)=fic) if A@>O and A/V) >A) Ota) 
or m(j)<w()AV) 


orif (i) <i(i) and m,(i) = w,(i)i,(i). 
Then the labor market conditions for acceptability to player (1,/) are 


HG) — 1.) ~ if m,(i) = w,(i)h (i) and (W/)i(j) S4()) 
and m(j) 2wi(J/)4(/) 


1,(i) =0_ otherwise 


so that player 3’s supergoodness problem becomes: 


max AG) = (p?/2n) (YAW)? = ym(i) s.t. (14) 


(A(/), mi) 

Qian @)\= 1)» Git m,(i) = w, (i) h(i) 
and (Wj) A(/)S h(i) 
and m,(j) 2wi(J)h()) 


=0 otherwise, 
the solution to which is (provided profits (14) are positive): 
EGO T@) 
m, = w,(i)/,(i) 


for all i. (Note that the wage part of (9*a), 
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mj) <wi(AG) 
is in fact redundant.) Then for equilibrium we have 
(i) =h(i) =) (Wi) 
L(i) = B (Vi) 
w\(i) = w,(i) (Vi) 
w(i) = W,(i) =w, (Wi) 


YAW — = (DAW) 


4 3 
p = 
z nB (1 — 'hB) 
be 4 
W, = ap 
pO: 


Thus (9*) works as promised; given positive profits it turns the determina- 
tion of wages and hours into a matter for bargaining between labor and 
management—a matter largely undetermined by so-called “market forces.” 


WV 


The commitments (9*a) work in part because they command the unani- 
mous consent of all workers. What if they don’t command unanimous con- 
sent? A way to look at this question is to study a case of discrimination. 

For suppose that player (1,”) is not very well liked by his clone col- 
leagues. Accordingly they set very low values of i(n) and w,(n). Player 
(1,n) disagrees. Thus while for i = 1,..., — 1 commitment (9*a) holds 
for i = n we have 


Zin) =Sin) if h(n) <A(m) and m,(n) = %(n)h(n). (9**a) 


Then player 3’s supergoodness problem essentially becomes a choice 
between two alternatives (assuming both produce positive profit). The first 
alternative is to go along with players (1, 1)...(1,” — 1). Then player 3’s 
supergood set has 


JG) == bah ee ae eee (15) 


and his maximand has value 


PDA) — (/2n) Pp’ (LAW)? — YMA. (16) 
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The other alternative is to go along with player n. Then player 3’s super- 
good set has 


(i) =0 Ti Ale eee (17a) 

I(n) = i(n) (17b) 
and his maximand has value 

p'l,(n) — (1/2n) p*(i(n)y? — wy (n)](n). (18) 


If (16) is greater than (18), then player 3 chooses the first alternative. For 
agreement we need as with (9*a) 


hi) =h@ =]@ (vi) 
and in particular 
I(n) = i,(n) 7a 1,(n) 


1.e., player 3 must agree with players (1, 1),...(1,2—1) that n should be 
discriminated against. But this situation can be part of an equilibrium only 
if it is an NE, and it is an NE only if it is acceptable to player (1,”). A 
situation is acceptable to player (1,7) only if /,() equals either i,(n) or 0. 
Since in this case /,(n) # /,(n) ex hypothesi 


L(x) =i,(n) =i) =0 


is a necessary condition for this sort of equilibrium. 
If (16) is less than (18), the same sort of argument will show that neces- 
sary conditions for equilibrium include: 


Loo 0) °t—ton— 1 
I(n) = 1,(n). 


If (16) equals (18) either equilibrium is possible, but not both or any 
convex combination. 

We can draw two conclusions from this model by drawing on the two 
different motivations for this section: 


1. For the study of discrimination, we see that discrimination by workers 
requires employer concurrence (not necessarily vice versa), and will 
result in the complete exclusion of one group or another. The latter 
conclusion would be better confirmed empirically if we had developed a 
more complex model with a number of different kinds of jobs within the 
one industry. Then we could have seen exclusion from particular types 
of jobs, even in the very long run, since we are describing an equilibrium. 
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Long run discriminatory results are extremely hard to come by, if not 
impossible, in Walrasian models. 

. For the study of labor organization, we see that to the extent to which 
union membership is equivalent to concurrence in bargaining demands, 
some sort of union shop or closed shop arrangement is a necessary condi- 
tion for equilibrium in an organized labor market, quite apart from argu- 


ments about public goods. 


9 = Booms and Busts 


Fortuna vitrea est; tum cum splendet, frangitur. 


PUBILIUS SYRUS 


Production and consumption are not the only activities that go on ina mod- 
ern economy; saving and investment, technological change, birth, death, 
and speculation happen as well. Reasonable macroeconomic models ought, 
and are expected, to include room for all (at least) of these phenomena. 

This chapter will develop one such model. Models are useful only to the 
extent that they are incomplete, since simplicity is achieved only by chop- 
ping away realism, and so the many unrealistic simplifying assumptions 
that have gone into this model call for no abject apology. On the other 
hand, there is no reason to suspect that the model cannot be improved 
upon. 

The world we will consider has embodied clay-clay technological change, 
no depreciation, uncertainty, and lasts forever. As in standard macroeco- 
nomic models, there are two inputs (labor and capital), one output, and 
two types of nongovernment agent: the household, which sells labor and 
buys bonds and output, and the firm, which buys labor and sells bonds and 
output. (Our firm also buys and sells capital.) The distinction, however, 
among “long-run,” “medium-run,” and “short-run,” is absent from (and alien 
to) our model, as is, of course, the idea of expectations. Everything is built 
up from the tradition of rationality. 


I 


Keynes emphasized the importance of uncertainty in economic affairs, and 
a model in which the future held no mystery might miss many significant 
macroeconomic phenomena. The economic games that we have discussed 
so far, however, all had equilibria in pure strategies: there was never any 
doubt about what anyone would do in equilibrium. For a game to have an 
equilibrium in mixed strategies, it is necessary that at least one player finds 
it optimal to choose a mixed rather than a pure strategy. With the convex 
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payoff functions that generally characterize economic games and the type 
of perturbation that everything resembling a price or a price-and-quantity 
commitment pattern makes in those payoff functions, mixed strategy equi- 
libria are impossible (even with “price-like” commitments in mixed strategy 
space). 

There are two ways that mixed strategy equilibria can appear. One way 
is to introduce nonconvex technology and payoff functions (that is why 
simple finite games often have mixed strategy equilibria); the other way is 
to introduce a player— Mother Nature, as we discussed in chapter 5 — who 
is indifferent among all situations but makes a commitment to engage in 
a particular mixed strategy. This latter course is the one we will follow. 
Mother Nature’s job will be to determine the rate of technological change. 
The other players will turn out to choose pure strategies in equilibrium, but 
local strategies in these pure strategies will be contingent on what Mother 
Nature does; thus Mother Nature’s participation will make the whole sys- 
tem stochastic. 


II 


Besides Mother Nature, the players in the game we will be studying are a 
Federal Reserve Bank, a sequence of households, and a sequence of firms. 
Like Mother Nature, the Federal Reserve Bank in this chapter will be 
indifferent among all situations, and will have made an essentially arbitrary 
commitment. The other players can thus treat it like a vending machine 
whose owners have departed to Mars. In the next chapter we will discuss 
macroeconomic policy more interestingly. 

A new household Ht and a new firm Ft are born at the start of period 1; 
both live for two periods. 

Firm ¢ begins life by choosing a quantity (1) of bonds to give to the old 
household H(t—1); the household gives the firm a quantity of money 
m(H(t—1), F(t), 6). We will see later just what these bonds are; think of 
them now as just pieces of paper. The new firm then chooses a quantity of 
money m(F(t), F(t — 1)) to give to the old firm; the old firm then gives the 
new firm a collection of machines ( K(t, v)). K(t, v) stands for the quantity 
of machines that were made at time v < ¢ — | (“vintage v”) that firm (t — 1) 
gives to firm 7. 

Firm ¢ also gives money m(Ft, Ht,t) to household ¢ and receives a 
vector of labor (/(t, v)) from that household. /(t, v) denotes the amount of 
labor applied to vintage v machines. 

Firm ¢ uses these machines and labor to produce all-purpose output 
Y(t). The production function is 
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t-l 
Y(t) = > a(v) min[K(z,v), /(2,v)] (1) 
v=l 


where a(v) is a technological parameter that is generally growing as v 
increases, but we need not insist on strict monotonicity (sometimes tech- 
nology screws up). Note that (1) does not require that technical progress be 
Hicks-neutral; it requires only that a unit of vintage v capital be defined as 
that amount that requires one unit of labor to work with it. The Leontief 
production function is, however, a substantive restriction. 

Next, firm ¢ chooses amounts y,(t) and y;(t) of output to give to house- 
hold (¢ — 1) and firm (¢— 1), respectively. This is for consumption. These 
players give firm ¢ money amounts m(H(t—1), Ft, y) and m(F(t— 1), Fr) 
respectively. 

The final event in period r is Mother Nature’s move: she picks a techno- 
logical parameter a(t) to determine how much output a unit of vintage 
capital—that is, a unit of period ¢ output used for manufacturing purposes 
—will be able to produce in the future (given adequate labor). We let the 
set A with typical element a denote the possible values that Mother Nature 
can assign to a(t). We assume that ¢, is the probability that Mother Nature 
has committed herself to for assigning value a to a(t). The set A and the 
probability assignment @ vary with time—otherwise we would not have 
technical progress in general—but we will suppress the “t” subscript to 
save notation. 

In period (+1), firm ¢ gives firm (+1) a vector (K(a,1+1, v)) of 
machines and receives a quantity of money m(a, F(t+1), Fr). The argu- 
ment a indicates that both players’ actions may be contingent on Mother 
Nature’s action in period ¢ (just as all actions in period ¢ were in fact 
contingent on Mother Nature’s actions in all previous periods—but nota- 
tion is something that should be economized). Firm f can give its successor 
every vintage of machine its predecessor gave it, and can also give machines 
of vintage t, Mother Nature having determined their productivity. 

Then firm ¢ pays money m/(a, Ft, Ht, +1) and m(a, Ft, FRB) to house- 
hold ¢ and the Federal Reserve Bank respectively (we will recognize these 
payments later as debt service), and money amount m/(a, Ft, F(t + 1)) to 
firm (+1). Firm (t+ 1) gives firm ¢ an amount y,(a,t+ 1) of period 
(t+ 1) output. This completes firm r’s life. 

Its payoff function is the expected value of its consumption, 


d 6. y¢(a,t+ 1) 


and its choice of variables is subject to constraints forbidding paying more 
money than is received 
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m(Ft, F(t—1)) + m(Ft, Ht,t) = m(A(t—1), Ft, 6) 


m(Ft, F(t—1)) + m(Ft, Ht, t) + m(a, Ft, Ht, t+ 1) 
+ m/(a, Ft, FRB) + m(a, Ft, F(t+1)) S m(A(t— I), Ft, 6) 
+m(H(t—1), Ft,y) + m(A(t—1), Ft) forall a€ A, 


constraints forbidding giving away more output than is produced; 
Vu (t) + yr(t) + K(a,t+1,t)S Y(t) 


and constraints forbidding giving away more used machines than were 
received: 


K(a,t+1,v) = K(@t,v) forall a@e&A and Vee 


The account of firm ¢’s life has already revealed much about household 
t’s life. We have already seen that in period ¢ household ¢ chooses labor 
vector /(t,v) and receives money amount m(Ft, Ht). Household ¢ then 
chooses a money payment m(H1, H(t — 1)) to make to household (t — 1) 
and receives an amount of bonds 4(r) from that household. 

In period (¢ + 1), after Mother Nature has picked a, household ¢ receives 
a money amount m(a, FRB, Ht) from the Federal Reserve, and gives the 
Federal Reserve a money amount m(a, Ht, FRB). The Federal Reserve 
gives household ¢ b* (a,t) bonds, where we allow b* (a, 1) to be negative to 
reflect a payment from the household to the bank. In fact, it is only the net 
of these transactions that will concern us. 

Also in period (+1), household ¢ gives firm (¢ +1) money amount 
m(a, Ht, Ft +1, b) and receives b(a,t+ 1) bonds. Household ¢ receives 
the money amount m/(a, Ft, Ht,t+ 1) from firm ¢ as debt service. Then 
household t gives household (1 +1) b(a,t+1) bonds and receives m(a, 
H(t+1), At) money. Finally, household ¢ gives firm (f+1) the money 
amount m(a, Ht, F(t+1),y), receives yy(a, t+ 1) output, and expires. 

Household ?’s payoff function is the expected value of its consumption 


do. yx(a,t+1) 


and its constraints forbid it from giving away more money than it has: 


m(At, H(t—1)) + m(a, Ht, FRB) — m(a, FRB, Ht) 
+ m(a, Ht, F(t+1),b) S m(Ft, At) forall aG A 


m(At, H(t—1)) + m(a, Ht, FRB) — m(a, FRB, Ht) 
+ m(a, Ht, F(t+1),b) + m(a, Ht, F(t+1),y) S m(Ft, At) 
+ m(a, H(t+1), At) + m(a, Ft, Ht,t+1) for all a € A, 
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H(t-1) H(t) F(t—1) F(t) FRB MN 
m—FRB b*—H(t—1) 
b*—FRB m—H(t—1) 
m= Ft b—H(t—1) 

K-— F(t) m—F(t—1) 
/— F(t) m— H(t) 


m—H(t—1), FRB 
b>H(t—1) m—H(t—1) 
m-— F(t) m-— F(t) y—HA(t—l), F—1) 


Figure 5 


from supplying more than one unit of labor 
dv) <1 
and from giving away more bonds than it has received 


b(t) +b*(a,t)+b(a,t+1l)=b(a,t+1) forall a€A. 


The assumptions of risk neutrality and no consumption until old age are 
quite restrictive, but make the computations tractable. 
Figure 5 provides a useful summary of what goes on in a typical period 1. 


Ill 


We will consider commitment patterns of what Malinvaud (1977) calls the 
“Keynesian unemployment” family. In these commitment patterns house- 
holds are quantity-constrained in the amount of labor they can supply 
and firms are quantity-constrained in the amount of output they can sell; 
otherwise commitments are of the pure price variety. Malinvaud’s other 
“regimes” (classical unemployment, repressed inflation, and Walrasian full 
employment) can also be studied in this game, but Keynesian unemploy- 
ment has historically received the greatest attention, and, we will see, has 
considerable explanatory power. 
We define 


D(t—1) = D(t—2) + b(t-1) 


the debt that has been accumulated at the beginning of period 1. 
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The commitment patterns we will be interested in have the following 


form 


Sul) =f) if w(t) Sh tv) # m(Ft, Ht) 


or if 


or if 


or if 


or if 


or if 


or if 


or if 


=0 


u(t) b(t) < m( Mt, H(t—1)) 


u(t) b*(a,t) < m(a, Ht, FRB) — m(a, FRB, Ht) 
for any a 


i(a,t+1)b(a,t+1) < m(a, Ht, F(t+1),b) 
for any a 


u(a,t+1)b(a,t+1) ¥ m(a, H(t+1), At) 
for any a 


p(a,t+1)yy(a,t+1).< m(a, Ht, F(t+1),y) 
and yy(a,t+1) S Fy(a,t+1) foranya 


P(a,t+1)¥y(a,t+1) < m(a, Ht, F(t+1),y) 
and yy(a,t+1) > jy(a,t+1) foranya 


m(a, Ft, Ht,t+1) < b(t) + b*(a,t)  foranya 


otherwise 


&r(*) = fn) if a(t)b(1) ¥ m(H(t—1), Ft, b) 


or if 


or if 


or if 


or if 
or if 
or if 


or if 


or if 


SI a(t,v) K(t,v) — a(t) D(t—1) 
<m(Ft,F(t—1)) and K(t,t—1) S K(t—1) 


S2 g(t,v) K(t,v) + g(t,t—1) K(t—-1) 
— a(t)D(t—1) < m(Ft, F(t—1)) 
and K(t,t—1) > K(t—1) 


Sto Ut, v) w(t) ¥ m(Ft, Ht) 
and Si U(t,v) S/1(t) 


I(t)w(t) # m(Ft, Ht) and S'2) U(t,v) > 7(t) 
P(t) y(t) # m(A(t—1), Ft, y) 
P(t) yr(t) ~ m(F(t— 1), Ft) 


Si-1 9(a,t+1,v)K(a,t+1,v) — a(a,t+1) D(t) 
~ m(a,F(t+1), Ft) for any a, 
where g(a,t+1,1) = p(t) foralla 


m(a, Ft, Ht,t+1) # b(t) + b*(a,t) for anya 


(2-1) 
(2-2) 


(2-3) 


(2-4) 


(2-5) 


(2-6) 


(2-7) 


(2-8) 


(2-9) 


(2-10) 


(2-11) 


(2-12) 


(2-13) 
(2-14) 
(2-15) 
(2-16) 


(2-17) 
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orif m(a, Ft, FRB) ¥ D(t—1)+4(t)—b(t)—b*(a,t) (2-18) 


for any a 

orif p(a,t+1)y-(a,t+1) < m(a, Ft, F(t+1)) (2-19) 
and y-(a,tt+1) S p(a,t+1) — Fy(a,t+1) 
for any a 

orif p(a,t+1)[¥(a,t+1) — Fy(a,t+1)] (2-20) 


< m(a,Ft,F(t+1)) and y,(a,t+1) 
> p(a,t+1) — Fy(a,t+1) for anya 


=0 otherwise 


Srre(*) = Srra(*) if u(t) b*(a,t) # M(t) — M(a,t+1) (2-21) 
for any (a, 1?) 


orif u(t)b*(a,t) ~ m(a, Ht, FRB) — m(a,FRB,Ht) (2-22) 
for any (a,1) 


orif m(a,Ft, FRB) < D(t—1) + 4(t) — b(t) — b*(a,t) (2-23) 
for any (4,1?) 


=0 otherwise. 


In (2-1) Ht promises to sell labor to Ft at wage w(t), in (2-2) and (2-3) 
it promises to buy bonds from H(t—1) and the FRB at price u(r), and, in 
(2-4), from F(t+1) at price a(a,t+ 1). It promises to sell bonds to its 
successor at price u(a,¢+1) in (2-5) and to buy output from F(t+ 1) at 
price p(a,t+ 1) in (2-6) and (2-7). However, Ht will pay for no more than 
Jy(a, t + 1) output. 

From (2-8), (2-17), (2-18), and (2-23) we see what bonds are: a bond is a 
promise that its holder will be paid one unit of money every period (starting 
the period after it is issued), no matter what Mother Nature does. In (2-17) 
and (2-18), Ft promises to pay current bondholders what they are due, and 
in (2-8) and (2-23) the current pondholders— Ht and the FRB—require 
that payment. Notice that we make no provision for bankruptcy; concep- 
tually it would be easy to modify these lines to do so, but the computational 
burden would be considerable. 

In (2-9), Ft promises to sell bonds to H(t—1) at price @(r). In (2-10) 
and (2-11), Ft promises to buy machines from F(t—1) at prices q(t, v). 
Buying the machines carries with it the responsibility for servicing the 
existing debt D(t—1), and so the cost of the machines is reduced by the 
cost of this debt a(t) D(t—1). In addition, Fr will pay for no more than 
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K(t— 1) of the newest vintage of machines, that is, those that come from 
(t — 1)’s output. (In common macro parlance, K(t, — 1) is investment.) 

In (2-12) and (2-13), Ff promises to buy labor at wage w(r), but no 
more than /(t) of it. To make rationing interesting, we assume /(1) < 1. 
In (2-14) and (2-15), it sells its output to consumers at price p(t), and 
in (2-16) it sells its output (as investment good K(a,1+1,1)), its used 
machines and the responsibility for servicing the debt to its successor firm. 
In (2-19) and (2-20), Ft promises to buy output from the successor firm at 
price p(a,t+1), but no more than j(a,1+1) — Fy(a,t+ 1) of it. 

In (2-22), the FRB promises always to buy and sell bonds at the going 
secondary market price u(t). By buying bonds, it increases the money 
supply; by selling them it decreases the supply. In (2-21), we state that the 
Federal Reserve has committed itself to a particular arbitrary path of 
money supply M(t). This path is a parameter of the commitment pattern. 


IV 


Virtually every situation where one of its own commitments is not being 
violated is acceptable to every player, and every situation acceptable to the 
other players is good for Mother Nature and the Federal Reserve Bank. 

Household #’s supergoodness problem becomes, after suitable substitu- 
tions 


Wit Pie ye f 
ep py Maen (wi) DMGv) + [wart FI u(t)] X 


[b(t) + b*(a,t)] +[u(a,t+1) — a(a,t+1)]b(a,t+D}, s.t. 
u(t)[b(t) + b*(a,t)] + A(at+1) b(a,t+1) < wi) 2 Mtv) (Va) 
Lav) </(t). 

Obviously 
Liv) = 10) (3) 


in Ht’s supergood set. If 


d, u(a,t+1)+1 > d, u(a,t+l) (a) 


a p(attl) u(t) a P(a,ttl) u(at+l) 


household ¢ would invest all its money in b(t) and b* (a, 1); there would 
be nothing left for buying newly issued bonds b(a,¢+1). Firm (t+ 1) 
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could not operate and would not agree with Ht’s refusal to lend it money. 
Thus there can be no equilibrium involving a commitment pattern in which 
(4) held. On the other hand, if the inequality in (4) were reversed, house- 
hold ¢ would buy bonds from neither its predecessor nor the Federal Re- 
serve, and there would be a similar failure of agreement. Thus 


S a a An db, 


TO) Rn Se (5) 


a 
is a necessary condition for a commitment pattern to have an equilibrium. 
We call (5) the sensible behavior condition for household t. Given (5) any 
feasible portfolio is acceptable to At. 

After similar substitutions, firm t’s supergoodness problem becomes 

Pa 


max xd CoN {p(t)y(t) + p(t) K(a,t+1,t) 


uM 


= > [(q(t,v) — g(a,t+1,v)) K(t,v) t+ w(t) l(t, v)] 


— [h(t) + D(t—1)][a(a,t+1) +1 —a(t)]}, st 


7 


=) 


[qg(t,v) K(t,v)+w(t)(t,v)] S a(t)[D(it—1)+4(t)] 


y(t) = y(t) 

K(a,t+1,t) < K(a,t) (Va) 
y(t) K(a,tt+1,1)< dS Y(4v)a(v) (Wa) 
Y(t,v) < K(t,v) (vv) 
Y(t,v) S l(t, v) (Vv) 


where Y(t, v) a(v) is the output produced from the process using vintage v 
machines, and y(f) is the total output sold to consumers (the old firm and 
the old household). We have already taken advantage of the obvious rela- 
tionship that 


K(a,t+1l,v)= K(t,v) if q(at+1,v)>0 


for all vintages of capital that Ft acquires: the firm wants to sell whatever 
used machines command a positive price. 
Next, note that unless 


ba a(a,t+1)+1 


Mee ay al eC 
py Peay eh ae ”) 2 oe) a(t) (©) 
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firm ¢ will be able to expect a real profit on each unit of vintage v capital it 
buys, simply by holding onto it. Then it would want an infinite amount of 
vintage v capital and agreement would be impossible. Thus (6) must hold 
for all v or there is no equilibrium. On the other hand, if 


o, (att) +1 
> path ne ee ay rer a(t) @ 


any amount of K(t, v) being held for purely speculative purposes without 
producing any output is supergood for firm r. We will denote by V,(1) the 
set of vintages v for which (7) holds. 

If we let V,(1) denote the set of vintages for which output is positive, we 
have the following supergoodness conditions: 


D(t—1) = anything 
I(t,v)= Y(t,v)20 if vE V(t) 


I(t,v) =0 if v¢é V(t) 
I(t,v) = K(t, v) if v ¢ V(t) 
yi) — 7) (8) 


ee les o, 
«P| & cart 7 Re erary Tap Hater) + wl X 


fi(attItl _ 


= q(a,t+l,v)} =O for all v € V(t) 
u(t) 


corpo & rors Se that.) + wo] Xo) 


ack P(a,t+1) P(a,t+1) 

a(a,t+1)+1 

a a — q(a,t+1,v)} <0 for all v € V(t) 
ul 


where R is the set of a where K(a, r) is large enough that all output can be 
sold: 


= {a| K(a,1) > ev) ¥(t,v) — 5}. 


Equation (8) follows because, with the assumed equality of price for con- 
sumption and investment purposes, output withheld from sale for consump- 
tion will not necessarily be sold. 

Subtracting (6) from (9), we see: 


(a,t+1) +1 
«ore & Farry |= wi 3, eA nee i 


aceR ( u(t) 
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for all v € V,(t). Since there will be equality in (11) for at most one value of 
a(v), the intersection of V,(t) and V,(t) will have at most one value of 
a(v). For convenience we will assume this intersection empty. 

Subtracting (7) from (10): 


a(v) p(t) E seer < w(t) » we at Uatt rl (12) 


pai PG, tl) ne plat) u(t) 
for all v in V,(t) and not in V,(7). From (11) and (12) we see that a(v) for 
v € V(t) is always greater than a(v) for v ¢ V,(t) and in V,(t): every 
vintage that is producing is always more productive (newer) than every 
vintage that is being held idle. 


V 


Now we can consider the conditions that are necessary for agreement. A 
commitment pattern whose parameters do not meet these conditions cannot 
support an equilibrium. We will suppose that all parameters with arguments 
of (t — 1) or earlier have somehow been determined, as well as q(t, v) (for 
all ySt—1), u(t) and a(t); the problem becomes finding requirements for 
the rest of the parameters for period ¢ and those for subsequent periods. 

In the period t used machine markets, firm (t—1) wants to give firm f 
precisely what it received from firm (t — 2), for every vintage v with positive 
price. Thus for v S ¢—2, what firm (t—1) wants K(t, v) to be is deter- 
mined by history. We will assume that the same is true for vintage (1 — 1). 
On the other hand, firm ¢ wants a positive quantity of vintage v capital only 
if v € V,(t) or v € V,(t); if either is the case, any quantity is supergood for 
Ft. Thus if V,;(t—1) denotes the set of vintages v for which q(t, v) is 
positive, a necessary condition for agreement is 


V(t) U V(t) D V3(¢— D). 


Consider for a moment the vintages that are not in V,(¢ — 1); that is, the 
vintages with q(t, v) = 0. By (6), these vintages must be in V,(t), and by 
our assumption that V,(t) and V,(t) are disjoint they cannot be in V,(f). 
Thus every vintage v [ ¢—1 is in either V,(t) or V,(t), and hence, every 
vintage in V,(t) is more productive than every vintage not in V(t). 

In the labor market, firm t’s supergoodness condition is 

> K(hv) = > Mav) 

V(t) v 
while household t’s supergoodness condition is 


ice — 1): 
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Thus for agreement we need 


> K(,v) =7(). 


Vi(t) 
Since the K(t,v) are determined historically, this sets up a relationship 
between V,(r1) and /(r). In fact, if we let a( V,(1)) denote the smallest a(v) 
for v in V,(t), a( V,(t)) will be determined uniquely by I(t). 

In the market for debt, any value of D(t—1) is supergood for firm 1, 
while 


D(t—1) = Dit—2)+ b(t—-1) 


is supergood for firm (¢ — 1). This determines D(t — 1). 
In the market for new bonds, firm t’s supergoodness condition is 


a(t) b(t) > [w(r)I(t,v) + q(t,v) K(t,v)] 


+ ¥ q(t.v)K(t,v) — a(t) D(t-1) 


Vr(1) 
1-l 


w(t)l(t) + > q(t,v) K(t,v) — a(t) D(t—1). 


For household (1 — 1) it is supergood to lend firm ¢ whatever money it has. 
Whatever money it has is the total amount of money held by the nonbank 
public, M(t), less the amount of money that F(t — 1) is holding. Since all 
of what F(t—1) borrowed at the start of period ¢ has been used to buy 
labor and machines, the amount of money that F(t — 1) is holding at the 
beginning of period ¢ is precisely its receipts from consumer sales 


P(t— 1) [yr@— VD) + yx(t— I). 
Thus 
f(t) b(t) = M(t) — p(t— DL yet 1) + yx D] 
is supergood for household (tf — 1). Agreement, then, requires that 


M(t) — p(t—1)[ye(t—1) + yx(t—-1)] = wD) 


+ ¥ gtt,v)K(t,v) — a(t) D(t-D). 
v=! 


This expression can tell us what w(t) has to be in terms of predetermined 
parameters and /(): 


l 
w(t) = ia {M(t) — p(t—V[ye(t—-1) + dy (t—- 1] (13) 
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1-1 
— ¥ aev) Kv) + a) Dt}, 
v=! 
or, letting X(t) stand for the expression in curly brackets, 


w(t) = X(t)/1(t). 


In the market for consumption goods, firm t wants to sell y(t). House- 
hold (t — 1) wants to use all its money, u(t) b(t), to buy these, and so does 
F(t— 1) which has z(t — 1), its profit, in money. Thus 


u(t) b(t) +7(t—1) 
PON tee (14) 
J(t) 
gives the value that p(t) must have, where 


D2 \ = (= oC) LA (ND) SID) 


b(t) = b(t—-1) + a0 
= re {X@-—) + [eo —2G p> G1) — M(r-_ 1) + 1@)} 
and 


mel) — >, K(v) }pu—Daww)+4(ev) 





Vi(t—1) 
ny Pr a at 
[w(t—1) +q(t—1,v)] A= 
Ke Lae ai(t) 
+ Pan KG wv) Jan) q(t—1,v) a0=Ds 
In the (t + 1) output markets, we can find similar 
expressions: 
Baie by = Ph Gar Vee oe Deena “e) 
¥(a, 1) 
where 
I rs — 
b(a,t+1) = Fe A u(t)] b(t) 
— M(t)+ M(t+1)} 
and 


m(a,t)= > K(t,v) | pWa(v)taqtart 1,v) 


V(t) 
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—[w(t)+q(t,v)] ao 
u(t) 
+ 3 KG) Jalartlv)—a(uy) — 
Vs(1) a(t) 


ifaER, 


w(a,t) = p(t)[7(t) + K(a,t)] — & K(t,v){[w() + q(t, v)] X 


V(r) 


u(a,t+1) ‘5 ar 

eS ae q(a,t+1,v)} 

Lay, latar+i.y) atv) HTD) KG) 
V(t) a(t) 


if a ¢ R. Expression (15), however, differs from (14), in that it depends 
upon u(a,i+1), a(a,t+1), and q(a,t+1,v), which have not yet been 
determined. This situation can be partially rectified by considering the sen- 
sible behavior condition (5), the Ft supergoodness conditions (7) and (9), 
and a new condition needed to keep firm ¢ from wanting to enter the 
secondary bond market: 


{u(a,t+1)+1—u(t)} =0 (16) 


Then (15), (5), (7) and (9) together, and (16) make four sets of equations in 
four sets of unknowns: u(*,¢ +1), a(-,¢+1), g(,¢4+1, v) and p(-,t+ 1). 
But the number of unknowns is (¢ + 2)| A| and the number of equations is 
only |A| + 14+ 1. This disparity results solely from a lack of contingent 
claims markets and has nothing to do with our Keynesian rather than 
Walrasian approach. With |A| = 1—if there is no uncertainty—there is 
no problem. 

The requirements of agreement, then, do not determine uniquely what 
the parameters of the commitment pattern have to be. Putting additional 
requirements on the commitment pattern could determine the parameters 
uniquely, but we have little interest in doing so. Equations (7) and (9), for 
instance, tell us about the mathematical expectation of period (¢ + 1) real 
stock prices; I do not think we are entitled to ask for more. Economic 
theory, in this case, can talk only about statistical properties. 

We will, however, take advantage of the indeterminacy by adding one 
requirement for the sake of computational ease. This requirement is that 
p(a,t+1) = p(t+1) for all a € A: next period prices do not respond to 
Mother Nature. 
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VI 


So far we have described what equilibrium must be like—or what its statis- 
tical properties must be—given the quantity constraints / (¢)— which deter- 
mines V,(t) and V,(t)—j(t) and K(a,t). The question that remains is 
how the quantity constraints are related to each other. 

The key to resolving this question lies in inequalities (11) and (12). Let us 
rewrite these using (13), (14), (16) and the assumed constancy of p(t+ 1) 
with respect to Mother Nature: 


@(R) = SSS —____} (in) 
1(t)a(v) u(t) u(t) b(t) + 7(t—1) 


for all v © V{(t), and 


®(R) < ed wet tt (12*) 
( 1(t)a(v) (1) ii(t) u(t) b(t) +2(t—-1) 


for all v € V,(t), where 


@(R)= > 4, 


aER 
the probability that the sale of output is not rationed. Let us consider 
p(t) > 0 and (K(a,t)) as exogenously determined. This is, in fact, the 
Keynesian tradition, especially with regard to investment, where j(7) comes 
from stable prices and (K(a, t)) from “animal spirits.” 

Then ®(R) depends only on total output, which, since only the most 
productive capital is used, depends only on/(t). When/ =0, ®(R(/)) = 1, 
since there is no output and hence no chance that output will be more than 
people will buy. As / increases, ®(-) stays the same or goes down, as the 
more output there is, the greater the chance it will be rationed. The step 
function ® in figure 6 illustrates what this relationship might look like. 

On the right-hand side of (11*) and (12*), the situation is more com- 
plicated. Let Z denote the expression in curly brackets there, and label 
the various vintages v,, v.,...,¥,-, Im such a manner that a(v,) = a(v,) 
=...2 a(v,_,). (If scientific progress is monotonic, this will be in order of 
increasing age.) Let L(v;) denote the amount of labor that must be em- 
ployed if all vintages at least as productive as v,; are being used: 


Bo) = > K(t, vj). 


Let w(v,, 7) denote the value of the RHS for vintages v, when / labor is 
used 
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I L(1) L(v2) Lvs) Lvs) 1 
Figure 6 Figure 7 


w(vi,1) = (F(t) Z) /(a(,)). 


The family of functions w(v,, 7) is graphed in figure 7; for every v,, of 
course, (v,,*) isa right hyperbola. What matters for equilibrium is whether 
that w(v,, 7) for which 7 = L(v,) is the largest W(v;, 7) less than &( R(/)); 
for if it is, then (11*) and (12*) are satisfied and / is a level of employment 
which, with (1) and (K(a, 1)), can support an equilibrium. Define, there- 
fore, (7) = w(L' (7), 1) and restrict the range of W(-) so that L'(-) is 
always defined. The circled dots in figure 7 show how W(-) might look. 

If ¥(7) < &(R(/)) and there is no v, with ¥(7) < wW(v;, 7) < &(R(/)), 
then /is an equilibrium employment level. If W(-) is always below ®(-), but 
either full employment uses every vintage or there is no v, with (vj, 1) 
between W(1) and ®(R(1)), then full employment need not imply that 
rationing is impossible; it need only imply that (1) and (K(a,t)) are large 
enough that rationing is a sufficiently rare occurrence relative to the effici- 
ency of the oldest capital used at full employment. (If, however, WV is far 
enough below @ at full employment that some w(v,, 1) can intervene, there 
will be no Keynesian equilibrium.) If W(-) is always above ®(-), no em- 
ployment is the only equilibrium: even the most productive machinery is 
not productive enough to pay wages. 

When Y(-) is monotonically increasing and cuts through ®(-) from below, 
as in figure 7, equilibrium can be only at the last L(v,) before the cut, L(v;) 
in figure 7. In figure 7, L(v;) is in fact an equilibrium employment level, 
since 


(v4, L(v3)) > PCR(L(v;))). 


But the last L(v;) before the cut need not be an equilibrium, as figure 8 
illustrates. In this case L(v,) is not an equilibrium because w(v,, L(v;)) < 
©(R(L(v;))), and neither is L(v,), since ¥(L(v,)) > ®(R(L(y,))). The 
commitment pattern in figure 8 has no equilibrium although a small in- 
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Figure 8 


L(v3) Lvs) I 


crease in (t) could result in an equilibrium at L(v;). This difficulty can be 
obviated, though, if the amount of capital of each vintage is relatively small 
enough, and |A| is large enough that YW and ® can be treated as con- 
tinuous functions. With continuity there will be an equilibrium wherever VY 
touches ®; thus (j(t), K(a, t)) will always be associated with a Keynesian 
equilibrium unless they are so large that V is everywhere above ® including 
at full employment. (Even without continuity it is easy to prove that for 
every / with 


u(t) 


a(7) X(Oy(G1) 2 min b,] To 


[u(t) b(t) +r(t—1)] 


there is at least one ( (t), (K(a,t))) such that / is associated with ( (rt), 
(K(a,t))) in a commitment equilibrium; thus unemployment equilibria 
exist.) 

A more serious difficulty with the W function is that it need not always 
slope upward. It slopes upward if and only if the elasticity of a(/) is greater 
than unity; thus the slope of YW depends upon the economy’s history of both 
science and investment. Multiple equilibria, including equilibria where V 
cuts ® from above, are possible, as in figure 9a. 

Equilibria where VY cuts ® from above, however, do not have the “com- 
parative statics” properties we have come to expect in macroeconomics; we 
shall see this in the next section and next chapter. We will call such equi- 
libria “abnormal.” Fortunately, we have reason to believe that abnormal 
equilibria will be rare, especially in economies where most labor is em- 
ployed. If, for instance, the K(a, 1) are not widely dispersed in the neighbor- 
hood of the equilibrium, ® will fall very rapidly, making it difficult for ¥ to 
fall even more rapidly. Moreover, the slope of W will tend to increase as / 
increases, because equal absolute changes in / will bring about smaller 
percentage changes in /, and, if investment grew at about the rate of the 


152 SPECIFIC 


Ce 


Figure ga Figure 9b 


economy in the past, more changes of vintage. Even if a(v) is a constant, 
the larger equilibrium will be normal if, for instance, ® is weakly concave 
downward, as in figure 9b. We will confine our attention, therefore, to equi- 
libria that are not abnormal, but we should bear in mind that any results 
contingent on normality may be reversed, especially in an equilibrium of 
mass unemployment. 


Vil 


The last section’s analysis lets us see what influences the level of employ- 
ment. Increasing X(t), for instance, shifts the Y function upward, and 
assuming normality decreases the level of employment required for given 
(5(t), K(a,t)) (precisely, it does not increase the level). Decreasing p(t) 
has the same effect; thus there is a presumption for a Phillips’ curve rela- 
tionship. 

Note that wages are not in any sense sticky. Given X(t), higher em- 
ployment means lower wages, and vice versa. 

Note also that (5) and (16) keep the real rate of return on investment at 
zero in mathematical expectation. This is to be expected in a world of risk 
neutrality where households save all their income. An expanded, more com- 
plex model would be needed to study the rate of interest; key to under- 
standing it will be the interplay of household and firm risk aversion. 

We can use these ideas to see how the system evolves over time, and in 
particular, why we might often experience oscillations in employment. Let 
us look, therefore, at the equilibrium in period (7 + 1). 

The first determinant of (¢ +1) period employment, given a, is X (a,t+1): 


X(a,t+1) = M(a,t+1)—p(t)[yr(t) + yx(1)] 


= 3 q(a,t+1,v) K(a,t+1,v)+a(a,t+1) D(t). 
1 


v= 
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We know, however: 

q(a,t+1,t) = p(t) (Va) 

K(a,t+1,v) = K(t,v) (Wa) (Vv) 

D(t) = D(t—1) + b(t) 

b(t) = C/aixen+ & q(t,v) K(t,v)J]— D@t—1) 
and hence 

DG) = C/amixent q(t,v) K(t, v)]. 
Substituting we obtain: 


BA) = Nias De 
u(t) 


— P(t) [ye(t) + yy (t) + K(a,t+1,1)] 


+ ¥ K(t,v) ree 
vel u(t) 
Substantial random movements are thus possible in X(-); quite aside from 
any considerations of economic theory we have no way of taming it. Since 
we have (7) and (9), though, and we know that sales are equal to production 
when a € R, we can make a definite statement about the mathematical 

expectation of X(-,7+1): 


a(t») —a(atti.v)} 


EX(-,t+1) = EM(-,t+1)—p(t) ¥ bl 5() + K(a,2)] (17) 


a¢R 
— A/a XO +X av) Kv) 


where EF is the mathematical expectation operator. 

From this we see, first, that a large X(t) tends to make for a small 
X(t+ 1), and vice versa. Everything else somehow being equal, X(-) will 
tend to oscillate, and unemployment with it. 

On the other hand, the higher employment is in period r, given f(t) and 
(K (a, t)), the more states will be rationed and the higher will be the values 
of [ (1) + K(a,t)] in those states. This will decrease EX(-, 1+ 1), increase 
employment in period (t +1) and accentuate the cycle. This story of un- 
usually high employment cumulating holds, however, only if employment is 
unusually high in period (t + 1) because costs are abnormally low or pro- 
ductivity abnormally high. If period t employment is high because ( (fr), 
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(K (a, ))) is unusually high, few states will be rationed and the stimulus to 
period (¢ + 1) will be less. 

But X(-) is not the only thing that changes systematically between peri- 
ods; technology does, too. A new vintage of machine is available in period 
(¢ + 1)—vintage s—and since the almost inexorable march of progress 
means that vintage ¢ machines will be among the most productive around, 
there will be a new relationship between employment and output, and a 
new relationship between employment and marginal productivity. The first 
change will increase the amount of output for any amount of labor (as long 
as there is enough labor to use the new vintage), and thus decreases the 
probability of not being rationed. This shifts the © function down, and 
increases unemployment (as bewailers of technological unemployment, from 
the Luddites on down, have been quick to point out). The marginal pro- 
ductivity effect operates by shifting out on w(v,,-) curves. Assume, for 
simplicity, vintage ¢ capital is more productive than any other vintage. Then 
in period (t+ 1) 


Lina(vi) = Y K(tv,) + K(a,t+ 1,1) =L(v,) + Katt 1,t) 


jFi 


and 
Ws a(t) = Wa), 


Since L741, (/) is a more productive vintage than L' (7) was (the presence 
of a new vintage means that a given quantity of labor can be concentrated 
on a larger set of more productive vintages and not be used with some less 
productive ones), 


HLiac))) Se OY 
and 
W(1) < W() for all 7. 


Thus the W curve shifts down and employment increases. Which techno- 
logical effect will be stronger is indeterminate. 

The final determinant of period (f + 1) employment is p(t + 1). Remem- 
bering that 


u(a,t+1)b(a,t+1)+7(a,t) 


PE NS F(a,t+1) 


we might want to say that the higher the numerator, the higher the level of 
employment, since we might want to adjust j(a,¢+ 1) to hit a predeter- 
mined price. Then the higher the numerator, the higher j(a,¢+ 1), and 
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thus the higher the curve. If price is fixed, in other words, the ® curve will 
move to increase employment when the numerator rises; if j(a,¢+ 1) is 
fixed, the V curve will fall to increase employment; thus our concern is how 
the numerator 


TUCQat ta) (G50 t= l)) 1-7 (ast) 


behaves. 

The first term is the amount of money household ¢ can spend on con- 
sumption. This is largely determined by X(t). Thus we have another reason 
for oscillation: a large X(t) decreases employment in a period ¢, and in- 
creases it in period (t+ 1). Period ¢ profits (a, t), the amount of money 
firm ¢ can spend on consumption, depend on luck, but (7) and (9) can give 
us a mathematical expectation: 


E(r(-,t)) = p(t) d[ 50) + K(a,t)] 


a¢R 
the second expression in (17). The more rationing in period 1, the greater the 
mathematical expectation of profits, and the higher the level of employment 
is likely to be in period (1 + 1). 
Thus, on net, the oscillatory factors predominate. The macroeconomic 
world that this model gives us is characterized by cycles, a Phillips’ curve, 
and noise. That is not a bad description of reality. 


10 * Macroeconomic Policy 


MacLugaé, says Fionn,.... 


Without a fault of his, 

Beat not thy hound;.... 

In battle meddle not with a buffoon, 

For, O MacLugaé, he is but a fool. . . . 
Two-thirds of thy gentleness be shewn 

To women and to creepers on the floor, . . . 
And be not violent to the common people .. . 
Utter not swaggering speech, 

Nor say that thou wilt not render the thing that is night; 
For a shameful thing it is to speak too swiftly 
Unless it be feasible to carry out thy words .. . 
Neither for gold nor for other earthly valuables 
Abandon thou thy guarantee. .. . 

Stick to thy raiment, 

Hold fast to thine armature; 

Yet follow after gentleness, MacLugac. 


Agallam na Senoraé (“Colloquy of the Ancients”) 


Whenever Fionn MacCumail, the ancient Irish hero, put his thumb into his 
mouth and sang, whatever he was ignorant of was revealed to him. This was 
because he had accidentally burned his thumb while cooking the salmon of 
Fec’s pool—the salmon of knowledge—and had put it into his mouth. 
Fionn used this ability to detect his enemies and slay them; it also helped 
when he gave advice to his ne’er-do-well grandson MacLugac. 

More recently, economists have taken to solving systems of equations 
instead of sucking on their thumbs to gain Knowledge, and advising gov- 
ernments instead of grandsons. Just as the salmon of Fec’s pool that Fionn 
was cooking was not originally intended for his consumption (it belonged 
to the poet Finneces, who had caught it after a seven-year wait), so too are 
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the methods that economists use to acquire the wherewithal to slay and 
advise borrowed from their rightful owners. 

Economics has borrowed its method of advising from physics. Consider, 
for example, how physics would go about advising a cannoneer about the 
amount of powder and the muzzle angle that should be used in firing a 
particular ball from a particular cannon. A physicist would use the laws of 
physics and the dimensions of the cannon and ball to derive a system of 
equations in which the amount of powder and the muzzle angle would be 
unspecified parameters. Solving these equations would associate a unique 
trajectory (or, in more sophisticated versions, a unique probability distri- 
bution over trajectories) with each pair of muzzle angle and amount of 
powder. The physicist could then make predictions to the cannoneer: “If 
you use this much powder and that muzzle angle, then the cannonball will 
go thus-and-so.” Presumably the cannoneer would know the trajectory he 
wanted the cannonball to follow; thus when he had listened to the physieist’s 
predictions he could choose the muzzle angle and powder amount that 
would jointly yield a trajectory as close as possible to the desired one. The 
cannoneer would consider the physicist’s predictions useful advice. 

Traditionally, economists have tried to come up with useful advice for 
governments the same way that the physicist came up with useful advice 
for the cannoneer: by deriving systems of equations in which the variables 
the government was seen as controlling (tax rates and money supply, for 
instance) were unspecified parameters, and then solving these systems to 
associate a unique equilibrium or disequilibrium path with each set of 
government-controlled variables. The goal has been to make predictions 
like, “If you raise the tax on turnips by a nickel, the price_of onions will 
double”; for, when such predictions have been made, the government, 
knowing which equilibria or disequilibrium paths were most desirable to it, 
would choose the government variables that would yield the most desirable 
outcome. In this manner, it has been thought, economists would be pro- 
viding useful advice. 

There are two difficulties with this approach, both noted in the literature. 
The first is that economic theory may not yield unique predictions. This 
difficulty is especially prevalent in rational expectations models (see, e.g., 
Azariadis [1981]), but it afflicts, to a lesser extent, the standard Walrasian 
system as well (Arrow and Hahn [1971], chapter 9). The second and more 
fundamental difficulty, which has been pointed up by Kydland and Prescott 
(1977) and Kydland (1977), is that the government is not the only conscious 
actor in the economics world. The cannonballs (or Mother Nature) do not 
care what the cannoneer does, but the nongovernment actors do care about 
what the government does. The physicist is trying to advise a creature truly 
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exogenous to the system he or she is studying, but the economist is advising 
an entity whose actions are considered by the actors under study, an entity 
that is not a junior demiurge like the physicist’s advisee, but rather just 
another player in the game. 

The difficulty is analogous to Robinson Crusoe’s problem in chapter 5. 
Crusoe can be secular and listen to physicists when it is Mother Nature that 
puts coconuts in palm trees, because she does not care what he does. But 
when Friday puts coconuts in palm trees, Crusoe must participate in a 
game in which Friday cares what he does and he cares what Friday does. 
Since it is clever, caring Fridays that put coconuts in the government's palm 
trees and not icy indifferent Mother Natures, the government does not need 
a secular adviser like a physicist. 

But if the salmon of physics cannot allow economists to suck on their 
thumbs to slay enemies and advise governments, what useful advice can 
economists give to governments, or anyone else? What they can do is to 
describe commitment equilibria, and this is the most useful advice imagin- 
able. For in describing a commitment equilibrium one tells each player— 
and in particular, one’s advisee—precisely what threats and actions will 
yield her or him the greatest reward, given the threats and actions of the 
other players (over which, of course, there is no control). What better advice 
could there be? 

This chapter, then, is about giving this type of helpful advice to govern- 
ments. The governments we will be concerned with are altruistic but can 
produce nothing of intrinsic value to anyone; this is the tradition of macro- 
economic policy (public finance is the branch of economics having to do 
with governments that can produce intrinsically valuable items). The way 
to give this advice, we see, is to describe commitment equilibria in games 
that involve such governments as players. In this chapter we will describe 
some of the commitment equilibria of a game like the one we studied in the 
last chapter, but modified to make government more interesting. Along the 
way we will pause for some observations on the nature of altruism. 


I 


Let us suppose that there is a government in each period ¢ that has all the 
responsibilities of the Federal Reserve Bank of the period, as well as the 
ability to raise taxes and buy output. Provisionally we will assume that in 
the period ¢ government Gr seeks to maximize household (1 + 1)’s utility. 

Specifically, a typical period will now look like the table we have set 
forth as figure 10. Government ¢ and household (# — |) exchange money 
and bonds in the same sort of Federal Reserve transaction we had in the 
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H(t—1) H(t) E(t) F(t) G(t—-l) G(t) MN 
m~Gt b*—Hi-1 * 
b*—Gt m—Ht—| * 
m= Ft b—H1-1 
m—Gi-l bg Ht-1 

Kk Fi m—Fi—| 

Se m— Fi" 

l-Ft m— Ht 
m—Ht—1 m—Hi-\| 
m—-Gt * 


bo. at m= Ht) 
imal of m— Ft Fo) eh 


m-—Gt m-—Gt Zy.Zp 


*Denotes FRB transaction 


Figure 10 


last chapter. Household (t — 1) and firm (t — 1), however, make payments 
m(H(t—1), Gt) and m(F(t—1), Gt) respectively to government Gt after 
they have paid Ft for output. The government then chooses {0, 1} variables 
Zy(t) and z,(t), of which more will be said later. In the next period, Gr 
gives government bonds 4, (t+ 1) to Ht, and receives money m(a, Ht, Gt). 
It gives money m(a, Gt, Ft) to firm ¢ and receives output yg¢(a,t+ 1). 
Finally it makes payment m(a, Gt, Ht) to household 1. 

The government’s fiscal operations are subject to a budget constraint, 
which we will take to be binding: 


m(a, Gt, Ft) + m(a, Gt, Ht) <S m(A(t—1), Gt) + m(F(t— 1), Gt) 
+ m(a, Ht, Gt) for alla € A. 


The government—aside from Federal Reserve operations—cannot give 
away more money than it receives. The other players’ budget constraints 
must also be modified, in the obvious manner, to account for the new 
payments to and from the government. (Notice that we confine Federal 
Reserve transactions to commercial bonds, and government spending to 
investment goods; both of these restrictions are inessential.) 

Let 


Dg(t) = De(t—1) + Be (t) 


denote government debt. Then we will consider the following form of com- 
mitment by government Gr: 
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8a) =Sa() if u(t—1)b*(t—-1)# M(t—-1I)—- M(t) (1-1) 
orif u(t—1)b*(t—1) # M(H(t—1), Gt) (1-2) 
— m(Gt, H(t—1)) 
or if m/(a, Ft, Gt) << D(t—1) + b(t) — b(t) (1-3) 
— b*(a,t) for anya 
(1-4) 
orif m(H(t—1), Gt) < r(t)m(A(t— 1), Ft, y) 
and z,(t) =0 
orif m(F(t—1), Gt) < r(t)m(F(t—1), Ft) (1-5) 
and z,(t) = 0 
orif m(H(t—1), Gt) = r(t)m(A(t— 1), Fr, y) (1-6) 
and z,(¢) = | 
orif m(F(t—1), Gt = 7(t)m(F(t—1), Ft) (1-7) 


and z,(t) = | 
orif a(a,tt+l)hbg(a,t+1) ¥ m(a, Ht, Gt) for anya (1-8) 
orif p(a,t+1)yg(a,t+1) # m(a, Gt, Ft) foranya (1-9) 
or if m(a, Gt, Ht) ~# Dg(t—1) for any (1-10) 
=0 otherwise 


Lines (1-1) to (1-3) of this commitment are the same as the Federal 
Reserve commitment in the last chapter. In lines (1-4) through (1-7) the 
government promises to collect ad valorem consumption taxes at a rate of 
(1). The binary variables z,(+) and z,(-) represent the government's ability 
to use coercion. Let us rewrite the utility function for household ¢ as 


10,000 [1 — zy(t+1)] + de, 6, Yu (a, ¢ +1) 
and that for firm ¢ as 
10,000 (1 — z-(¢ + 1)] + 2.6, 6, yr(a,t +1). 


Then when the government chooses z,(t) = | a very bad thing happens to 
household (¢ — 1); similarly for firm (¢ — 1). Lines (1-4) and (1-5) threaten 
this bad thing unless they pay their taxes; lines (1-6) and (1-7) promise to 
refrain from the bad thing if they pay their taxes. In line (1-8) the govern- 
ment promises to sell government bonds at the going price for new bonds, 
and in line (1-9) it promises to buy output at the going price. In line (1-10) 
it promises to service the debt incurred by its predecessors. 
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We have already seen that the nongovernment players’ feasible sets and 
utility functions have had to be modified to account for the new type of 
government; we shall have to add some provisions to their commitments as 
well. 

For household t, we add to the commitment in chapter 9 taxes, a promise 
to buy new government bonds, promises to buy and sell government bonds 
in the secondary market, and a demand for debt service: 


8ur(*) = fiv(-) if (chapter 9) 
orif a(a,t+1)bg(a,t+1) # m(a, Ht, Gt) for any a 
orif m(a,Gt,Ht)#~ Dg(t—1) foranya 
orif u(t)bg¢(t) < m(At, H(t—1),g) 


orif u(a,t+1)bg(a,t+1) ¥ m(a, H(t+1), Ht, g) 
for any a 


orif m(a, Ht, G(t+1)) ¥ r(a,t+1)m(a, Ht, F(t+1), y) 
for any a 


= 0 otherwise. 


Similarly, firm ¢ also promises to pay its taxes 
8n(*) = fn(-) if (chapter 9) 


orif m(a, Ft, G(t+1)) # r(a,t+1)m(a, Ft, F(t+1)) (2) 
for any a. 


= 0 otherwise. 


With these changes we can easily construct supergood sets for firms and 
households. For both, we will need to use [1 +7(a,¢+1)]p(a,t+ 1) in- 
stead of p(a, 1+ 1) in the expressions for sensible behavior and demand for 
output. For households, we will have to talk about the sum of commercial 
and government debt instead of just commercial debt. For firms, we will 
have a new use for output. These minor changes give us the supergood sets 
for firms and households. 


Il 


Let us now consider the supergood set for government f, and recall our 
provisional assumption that government ¢ seeks to maximize the utility 
of household (t+ 1). To find government ¢’s supergood set we maximize 
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household (1 + 1)’s utility, subject to a series of feasibility and acceptability 
constraints, none of which can be among government f’s acceptability con- 
straints. It is easy to check, though, that in constructing a supergood set for 
household (¢ + 1) no acceptability constraints for government ¢ are used. 
Constructing this supergood set means maximizing H(t + 1)’s utility, sub- 
ject to no Gt acceptability constraints. Thus finding H(t + 1)’s supergood 
set is the same as finding Gr’s supergood set, and the two supergood sets 
must be identical. 

Because Gt’s supergood set is identical with H(1 + 1)’s the intersection 
of all players’ supergood sets is the intersection of the nongovernment 
players’ supergood sets. If that intersection is feasible and acceptable to-all 
players (including the government), then its members are equilibrium situa- 
tions. One need never bother with government supergood sets. 

How dependent is this handy result on our assumption that government f 
maximizes household (1 + 1)’s utility? Let us see what happens with alter- 
native assumptions about the government’s payoff function. Clearly there 
will be no change if government ¢ maximizes firm (f + 1)’s utility or house- 
hold (¢ + 2)’s, since no government acceptability constraints appear in those 
supergoodness problems. 

For firms ¢ and (f—1) and households ¢ and (f—1) the argument is 
more complicated, but the result is the same. Consider firm 1. 


m(a, Ft, Gt) => D(t—1) + b(t) — b(t) — b*(a,t) for alla (3) 


is a constraint in Ft’s supergoodness problem: firm ¢’s not paying interest 
on its commercial debt is not acceptable to government /. In Ft’s supergood 
set (3) is binding. Inequality (3) is an acceptability condition for Gr, how- 
ever; therefore (3) cannot be used as a constraint in Gr’s supergoodness 
problem when it maximizes firm 1’s utility. The negation of (2), however, is 
an acceptability condition for Ft, therefore, 


m(a, Ft, Gt) = D(t—1) + b(t) — b(t) — b*(a,t) (Wa) (3’) 


can be used as a constraint in G?’s supergoodness problem. Government f’s 
supergoodness problem then can be the same as firm ¢’s, except that it uses 
(3’) instead of (3). But since the answer will be the same no matter whether 
(3’) or (3) is used, Gr’s supergood set must be the same as Fr’s. (Note that 
all we require is that (3) or (3’) be an acceptability condition for some 
nongovernmental player—meddlesome neighbors are just as good as con- 
scientious actors.) Similar arguments hold for F(t —1), Ht, and H(t—1). 

Thus, no matter what nongovernment player’s utility—past, present, or 
future —the altruistic government acts to maximize, the equilibrium situa- 
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tions are the same: the intersection (if it exists) of the nongovernment 
players’ supergood sets and the set of NEs. 

Most of the time, however, economists postulate that altruistic govern- 
ments maximize some social welfare function that takes into account the 
utility of many players, not just a single one. Our result generalizes to fit 
this case as well. The way to generalize it is a theorem called Altruistic 
Contagion: 


Theorem 10 (Altruistic Contagion). Consider the game T = (I, S,f)* 
where fi (Ss) = 6, (fi (8), (3), .. «5 S08), - - - ff, (s)) and ©, is an arbitrary 
function, nondecreasing in each of its arguments. Let h\(s) = f,(s) and 
hi(s) = f,(s) for all i,j = 2, and let T' denote (I, S,h')* , i =2. Then (g,s)is 
an equilibrium of T if 

(a) for alli, (g,s) is an equilibrium of Y"', and 

(b) there is some j* => 2 for whom A (1, g) = A’* (1, g). 


Proof. Observe first that for all k, 7 = 2 


A(j,g) = A‘ (ig) (4) 


since these payoff functions are the same in I as they are in I. 

Now suppose (g, 5) satisfies (a) and (b) but is not an equilibrium of I. 
We will show that s © B(i, g) for all players. 

First suppose that s ¢ B(1, g). Then either 


(a) there exists aj > 1 such that s € A(j,g), or 
(B) there exists an s’ © P(1,g) such that 


as iS). (5) 


By (4), however, if (a), then s ¢ AX( j,g) and (g,s) could not be an equi- 
librium of I“, as required by (a). Thus (a) is impossible. 

Then suppose (8). From (5) and the nondecreasing property of {,(-), 
there must be some j > | such that f(s’) > f(s) which implies 


hj(s’) > hi(s). (6) 
From s’ € P(1, g) in (8) and (4), 
Races (ie): 


Together with (6), this implies that s is not good for 1 in I’, whence (g, s) is 
not an equilibrium of I’. Since this is a contradiction we conclude that s € 
B(1, g). 

Next suppose that s ¢ B(i, g) for some i > 1. Then either: 
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(a) there exists aj * i such that s ¢ A(j,g), or 
(8B) there exists an s’ © P(i,g) such that 


f(s’) > fi(s)- (7) 


For the same reason we showed above for player |, (a) is impossible. Thus 
suppose (B). In game I’*, (7) implies 


h;*(s’) > h;*(s). 

By (b) in the hypothesis and (4): 
Pize);= BS) 

so (8) implies 
ere) 


and s is not good for player i in I’’*; thus (g,s) is not an equilibrium of 
T’*. Since this is a contradiction, we see that s is good in I for all players 
and (g,s) is an equilibrium of [.  g 


The Altruistic Contagion Theorem applies to games and commitment 
patterns like those we are concerned with in this chapter and the last. Thus 
no matter what altruistic social welfare function the government employs, 
equilibrium situations are found in the intersection of the nongovernment 
players’ supergood sets and the set of NEs. To advise an altruistic govern- 
ment one need never find out its social welfare function. With this result, 
moreover, the assumption of one government per period becomes imma- 
terial. With a commitment pattern family like the one we are using and 
altruism, it does not matter whether there is one government for all time or 
many; nor does it matter which government chooses which government 
variable. 

These results also encourage speculation about the nature of altruism in 
general. Reread Fionn’s advice to MacLugac. Fionn tells MacLugac to be 
upright and gentle, but provides him with no formula to weight different 
individuals’ utilities. This absence of a social welfare function seems to 
be universal in pre-Newtonian social thought; Christianity, for instance, 
teaches that we should love one another, not that we should maximize a 
particular function. Those brought up in the predict-and-optimize school 
of economic advising have often, I believe, been secretly either puzzled or 
embarrassed by this phenomenon: that such a vast body of what almost 
everyone else has seen as wisdom should be seen by them as essentially 
useless rhetoric. Altruistic contagion shows us that when the proper ap- 
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proach to economic advising is taken—when we do not attempt to imitate 
physics—there is no reason for puzzlement or embarrassment. In tightly 
knit, contrapuntal commitment patterns, morality consists in the virtues of 
Fionn and the Gospels, and no social welfare function is required. The 
salmon of knowledge on which Fionn burned his thumb was by no means 
deficient. 


Il 


What matters, then, is agreement among the nongovernment players. This 
chapter did not substantially change their supergood sets from those we 
had in the last chapter; thus the agreement conditions do not substantially 
change either. For the most part, we need only garnish the last chapter’s 
conditions with some tax rates; we will not repeat those conditions here. 
We saw in the last chapter that the important concerns were the evolution 
of X(t), the amount of money available to pay wages, and of p(t), and 
the condition for the separation of vintages into V,(t) and V,(r). In this 
chapter’s game those conditions become: 


w(t)1(t) = X(t) (8) 
X(t) = M(t)—p(t-D{I +7¢—-D)SC-D tyet—-1I) + K(t,t—D} (9) 


art ly aS —1,v) K(t,v)| —De(t-1 
ai(t—1) I il q(t Vv) ») g(t ) 


+4(R,_,) p(t—1) y(t—1) 
EX(-,t+1) = EM(-,t+1)—p(t) d o,15(@)+ye(at+1) (10) 
a¢R 


Fp l =! 
+ K(a,t)]— iw XO + ¥ q(t,v) K(t,v)] 


— Det) -—7T() POI) 


= 1 X@) | tual 

®(R) = Bea)! a ay for all _v € V(t) (11) 
= | X(t) ; u(t)—1 

@®(R)< TENS fon ane for all _v © V,(t) (12) 


Leea@)b(t) Fac G—)) 
SOOT le ey 
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where &(R) = > d, and R = {al ¥(t)<p(t)+K(a,t)+ye(a,t+ Vj}. 


aER 

These conditions allow us to draw up a catalogue of equilibria that is our 
advice to the government. One way to arrange such a catalogue is to hold 
(5(t), (K(a,t))) constant, as we did in the last chapter, and see how the 
equilibria differ as we allow the various government variables to differ. 

First consider what happens when some y, (4, /+ 1) increases. For some 
values of /(1), ®(R), the probability of no rationing, will increase. For 
other values of /(1), there will be no change in &(R) either because output 
is so small at these values of /(1) that @ € R before the increase, or because 
output is so large at these values of /(1) that a ¢ R both before and after 
the increase. At any rate, ® will increase for some values of /(1) and de- 
crease for none. Nothing will happen to V(-), and so the new equilibrium 
will have higher employment, or no change. 

Let us consider further effects. Higher employment drives down wages 
by (8). If employment does not change because 4 ¢ R both before and 
after, then from (10) the mathematical expectation of X(-, ¢ + 1) decreases; 
this shifts the Y curve down in period ¢ +1, and increases employment 
then. If employment in period 1 does not change because @ ¢ R both before 
and after, there is no effect on EX(-, 1+ 1). If employment increases in 
period 1, @ switches into R; thus EX(-, t+ 1) increases and employment in 
period (¢ + 1) declines. 

When the tax rate 7(1) increases, p(t) falls by (13). From (11) and (12), 
W(-) shifts upward, period t employment falls, and wages rise. For period 
(t+ 1), however, EX (+, t+ 1) falls, both directly from the last term in (10), 
and indirectly, from increased rationing. Thus period (¢ + 1) employment 
tends to rise. Increased taxes also reduce D,(-, 1+ 1) by reducing the 
amount of borrowing the government has to do. This reduction, coupled 
with the decrease in EX(-, ++ 1), increases EX(-, +, 1+ 2) and tends to 
increase period (¢ + 2) employment. 

Finally, increasing M(t) increases X(t) and reduces period ¢ employ- 
ment. It raises EX(:, t+ 1), however, and Ep(-, t+ 1), and both of these 
effects increase period (¢ + 1) employment. 


IV 


Why does monetary policy (changing M(r)) seem to be so pusillanimous 
in this model? All it can do is decrease period ¢ employment and increase 
period (¢ +1) employment; but we have already seen that the model’s 
oscillatory tendencies almost assure that any period f disaster can do as 
well. 
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The reason is that we have opted to compare equilibria in which (f(r), 
(K(a, t))) are the same. Suppose instead that we compare equilibria in 
which w(t) are the same. Then (8) determines the level of employment 
and (f(t), (K(a,#))) must be found to make (11) and (12) hold. (This 
problem is easy to solve and has many solutions. The W(-) curve is given. 
One just has to arrange j(1) and (K,(a,t)) so that the ® curve cuts WV just 
above the /(1) from (8).) The higher X(r), the greater the level of em- 
ployment. Since X(t) still oscillates, employment still oscillates. 

From (9), increasing M(t) increases employment in period ¢, from (10) 
it decreases employment in period (t + 1). Increasing M(t) will also tend 
to increase period (t + 1) prices. Government purchases j, (a, t + 1), on the 
other hand, are impotent in period 1, as the V curve is determined by (8) 
and the ® curve must accommodate the V curve. To the extent, moreover, 
that government spending is financed by taxes or debt it decreases em- 
ployment in subsequent periods. If a € R, increasing y, (a, t + 1) decreases 
employment in period (¢ + 1) more or less directly through (10); otherwise 
its only effects are through taxes and debt. Increasing taxes decreases prices 
in period ¢ and employment in period (t + 1). 

A sticky-wage world thus seems quite different from an animal-spirits 
world; the gulf between monetarists and fiscalists seems wider than it is 
usually presented to be. Such a gulf, though, is illusory. The loose language 
of causality we have been using (“increase,” “decrease,” “effect”) is only 
metaphorical and should not be taken seriously. It is no ground for giving 
advice like a physicist (“Increase money supply in order to decrease un- 
employment”). 

Remember that ours is an exercise in taxonomy, not causality. We are 
cataloguing equilibria. Monetarists propose putting all equilibria with the 
same wages together in the catalogue; fiscalists propose putting all equi- 
libria with the same set of output constraints together. In either event, the 
contents of the catalogue will be the same. 


V 


Our advice to altruistic governments, then, is the same as our advice to 
altruistic individuals (indeed, the same as our advice to avaricious govern- 
ments and individuals): the catalogue of equilibria. If this catalogue had 
only one card, our advice would be just like a physicist’s, since our card 
would tell our advisee exactly what commitment to make and exactly what 
strategy to choose. Even if the catalogue had many equilibria (like macro- 
economics) and our advisee arrived at the scene after all the other players 
had irreversibly made their commitments and chosen their strategies, we 
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could still give unambiguous, physicist-like advice by finding the card in 
the catalogue that corresponded to what the others had already done. 

But when our advisee comes on time and the catalogue has many cards, 
then the multiplicity of equilibria is as much a source of freedom as it is a 
source of confusion. For then we and our advisee can attempt to have 
others commit and act in ways that result in better equilibria for us, just as 
they attempt to have us commit and act in ways that have better results for 
them. And so all the players persuade and cajole, argue and convince, hesi- 
tate and growl, issue ultimata and retract them, joke and scream, spy and 
lie, pound on tables and refuse to return telephone calls, laugh and cry, and 
in general behave like human beings have always behaved, except in eco- 
nomics books. Nothing should be less surprising. 


Ir = Conclusion 


Is fearr crioé na gno. 


Irish proverb* 


We have said a great deal now about game theory and macroeconomics. Let 
us see if we can make some sense of it, review what needs to be done, and 
look at a few of the broader implications of our methods. 


I 


Our goal has been to incorporate macroeconomics into the tradition of 
rationality that has been definitory of economics. There was no a priori 
reason for believing that such incorporation was possible, and only vague 
analogical reasons for believing it was desirable. Now we know that incor- 
poration is possible, and our suspicions about desirability, if they have not 
been fully confirmed yet, at least have not yet been shown to be misplaced. 

The first part of the book, the game theory part, served two purposes: it 
explicated the tradition of rationality and what that tradition entails, and it 
showed why certain approaches that have been taken in the past were 
incapable of providing the incorporation that we sought. 

In chapter 2, for instance, we found that game theory, while firmly within 
the tradition of rationality, had not been developed sufficiently to be of 
much help for the problems we were interested in. Cooperative versions of 
game theory did not permit these problems to exist, while noncooperative 
versions could generate only autarky. Neither, moreover, recognized the 
strategic moves—commitments, promises, threats—that Schelling found 
so important. 

Thus we developed the concept of “commitment equilibrium,” which we 
found to correspond to the basic notion of rationality that underlies the 
tradition in which we intended to work. Essentially, commitment equilib- 


* Generally translated, “Economy is better than business,” but literally, “End is better 
than work.” 
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rium extends the idea of Nash equilibrium to encompass strategic moves as 
well as strategies. At a commitment equilibrium, no player can improve his 
payoff by changing either his strategy or his strategic moves, given the 
strategies and strategic moves of the other players. 

On the other hand, in chapter 5, we examined the methods that sought 
to link external events to numerical probabilities in players’ heads. Keynes, 
Poincaré, Borel, and most explicitly, von Neumann and Morgenstern have 
all questioned the applicability of these methods to games of strategy. We 
found that Mother Nature’s vast indifference and the accompanying secu- 
larity axioms allowed these methods to be useful for games against nature, 
but that their utility did not carry over to games of strategy. In games 
of strategy, only commitment equilibria can be rational. Expectations — 
mappings of external events to numerical probabilities—are used in tem- 
porary equilibrium models, but temporary equilibrium is not equilibrium; 
temporary equilibrium permits irrationality. 

In the second part of the book, the economics part, we examined some 
particular commitment equilibria of some particular games. As with any 
economic investigation, we were especially interested in how our more 
general view of rationality related to the Walrasian view of rationality. 
Walrasian equilibria are the commitment equilibria that result when players’ 
commitments are of the pure price variety: that is, when players promise 
always to supply goods in strict proportion to the amount of money (or 
other goods) they receive and to supply money in strict proportion to the 
amount of goods they happen to receive. There are, however, other equi- 
libria that are associated with commitment patterns that are not of the pure 
price variety, and these equilibria include non-Walrasian phenomena like 
rationing and unemployment. There is nothing ad hoc, aprioristic, mystical, 
or unstable about these unemployment equilibria: they are full commit- 
ment equilibria just like the Walrasian equilibria are. They are equilibria 
the same way dual confession is an equilibrium in prisoners’ dilemma. Nor 
do the non-Walrasian equilibria disappear in the face of large numbers of 
agents. These results contribute to the rehabilitation, begun by Clower 
(1965) and Leijonhufvud (1968), of Keynes as an economic theorist. 

Our chief difference with the users of expectations in economics centers, 
then, around the relative priority of rationality and prices. Both of us are 
concerned with the inability of pure price commitment patterns to explain 
unemployment. Users of expectations react by keeping prices and modi- 
fying rationality by accepting temporary equilibria. Our approach is to 
keep rationality but modify price commitment patterns by accepting quan- 
tity constraints. 
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With this background we went on in chapters 9 and 10 to explore a 
complex model with banks, government, durable machines, stochastic em- 
bodied technological change, and several other features of real life. This 
model produced equilibria with business cycles, Phillips’ curves, and noise 
—a decent description of reality. Holding output quantity constraints con- 
stant, increasing government spending or decreasing taxes increases em- 
ployment; increasing money supply decreases employment. Holding wages 
constant, increasing money supply increases employment and prices; in- 
creasing government spending does nothing. Whether monetary or fiscal 
policy 1s more efficacious in combatting unemployment would then depend 
on whether wages or quantity constraints should be perceived as constant. 
Such is the interpretation, at any rate, if one considered the government a 
vending machine programmed by Martians eons ago. 

The correct interpretation, however, is much more subtle. The govern- 
ment must be considered as just another player in the macroeconomic 
game—altruistic and powerful perhaps, but another player nonetheless. 
An important finding of chapter Io is that altruism is such that, for suffi- 
ciently well-enforced families of commitment patterns like the one we used 
there, no explicit social welfare function is required for government, be- 
cause equilibria are the same no matter what altruistic social welfare func- 
tion is employed. (This result applies to altruism by individuals as well as 
altruism by governments.) The macroeconomic game with an altruistic 
government as a participant has many equilibria, some with full employ- 
ment, some with unemployment. In each of these the government is doing 
the best it can, given the commitments and actions of the other players. 

The best advice—and the only advice—that economists can give gov- 
ernments—or any other players—is simply a catalogue of commitment 
equilibria. This catalogue will tell each player how to do as well as possible, 
given the others’ actions and commitments. One way to arrange this cata- 
logue is to act as if quantity constraints were exogenous; another way is to 
act as if wages were fixed. In this way we can associate, say, equilibria with 
high unemployment and contractionary monetary policy, and we can out- 
line some necessary conditions for, say, full employment, but there is no 
foundation for the traditional type of causal language that we started to 
use above. Causal language may be appropriate in physical systems where 
secularity holds but it is not appropriate in games. 

The multiplicity of commitment equilibria, however, while it makes 
analysis difficult with a vocabulary developed for Newtonian endeavors, is 
what makes life interesting and what gives scope to free will. The trick is 
to cajole others into making commitments and choosing actions that will 
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result in an equilibrium more favorable to one’s objectives, be they avari- 
cious or altruistic or both. This applies to both governments and individuals 
alike, and is another “meta-game-theoretic” reason why the catalogue of 
equilibria is useful. 


II 


Of course we have by no means exhausted all questions of macroeconomics 
and game theory. We looked seriously only at special functions, simple 
models, and severely restricted families of commitment patterns, and the 
worlds we considered were wholly imaginary. 

The most pressing need, it seems to me, is for an econometric method to 
flesh out the skeleton of macroeconomic theory. Econometrics has always 
displayed tremendous ingenuity, and the work of Ito (1980), for instance, 
on the econometrics of “disequilibrium” (i.e., non- Walrasian) systems, may 
point to the way to the needed methods. 

On a more theoretical level, more general commitment pattern families 
should be explored, and mixed strategies should receive more attention (a 
bit of work in this direction is presented in Appendices A and, especially, B). 

Probably the most fertile area for theoretical advances is nonconvexity. 
It is well known that Walrasian rationality may be impossible when either 
payoff functions or strategy spaces are nonconvex, and Weitzman (1982) 
has recently argued that involuntary unemployment happens because of 
nonconvexity. The Nikaido-Isoda theorem, which we cited in chapter 2, 
leads one to suspect that nonconvexity is responsible for much of the un- 
certainty and speculation we observe in economic life (if people are not 
choosing mixed strategies why are their actions so unpredictable?). The 
Nikaid6-Isoda theorem and nonconvexity may in fact be related in a defi- 
nite way to the phenomena Keynes was alluding to in chapter 12 of The 
General Theory when he maintained that “there is no such thing as liquidity 
of investment for the community as a whole” (p. 155). 


Ill 


There is no reason why the methods we have used should be confined to 
macroeconomics. Chapter 8, to be sure, was concerned with microeconomic 
topics primarily, and in Appendix A we show that the methods yield quite 
interesting results when applied to questions of crime and the social con- 
tract. We concentrated on macroeconomics in this book because of its 
importance and high degree of controversy. But clearly there are problems 
in microeconomics that would benefit from a similar treatment. 
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Indeed we have already seen in chapter 9 how labor union organization 
and racial discrimination can be easily and illuminatingly portrayed within 
this framework. In view of the result reported by Arrow (1973) and Free- 
man (1976) that Walrasian analysis cannot give a convincing explanation 
or description of discrimination, further work in this area would seem 
appropriate. 

Another area that would seem ripe for application of these methods is 
housing. Houses are long-lived assets whose value now depends on what 
people think they will sell for later; thus there is an expectations morass 
from which conventional analysis cannot escape. In addition, there are non- 
market interactions through neighborhood effects, and a lumpiness problem 
because houses are typically sold through naked trade commitments, not in 
bits and pieces. For all these reasons a game-theoretic analysis seems to be 
the best approach here. 

On a more theoretical level, the consideration we have given to stra- 
tegic moves may shed some light on the questions raised by the Gibbard- 
Satterthwaite theorem. Gibbard (1973) and Satterthwaite (1975) indepen- 
dently showed that no basically acceptable deterministic social decision 
mechanism can always elicit true revelation of preferences; and Gibbard 
(1977, 1978) showed that random dictator and random duple mechanisms 
have certain distinct advantages over all deterministic mechanisms. Why 
then don’t people use random dictator and random duple mechanisms? 
There are thousands of state, local, and national governments, and millions 
of clubs and associations: why do randomization devices play such a small 
role in their politics, and commitments and promises such a large one? 
Perhaps further study of strategic moves can lead to an answer to this 
question. 

Unemployment and inflation, race, labor organization, housing, crime, 
the social contract, politics—these are not trivial matters, and we have 
seen that they are not matters that can be discussed adequately within a 
framework of secularity and Walrasian price commitment patterns. The 
grand tradition of rationality, however, may still be used. Commitment 
equilibrium shows one way of doing so. 
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A ® Hobbes, Cops, Robbers, 
and Mixed Strategies 


Non, mihi si linguae centum sint oraque centum, 
Ferrea vox, omnes scelerum comprendere formas, 
Omnia poenarum percurrere nomina possim. 


VIRGIL, Aeneid, book 6 


This appendix began in my mind as a discussion of crime. Like Becker’s 
(1968) seminal essay on the economics of crime, it was to have been essen- 
tially advice for police departments. Before providing useful advice, though, 
I had to answer two questions: why isn’t everybody a criminal? why are 
some people criminals? These two questions are ethical, not technological 
like Becker’s theory, and are quite difficult. Answering them, however, is a 
necessary preliminary to any serious discussion of the economics of crime 
and the subject of this appendix. We will start by examining the philo- 
sophically famous “state of nature.” 


I 
Hobbes (1651, 112-115) first investigated the state of nature: 


Hereby it is manifest, that during the time men live without a com- 
mon power to keep them all in awe, they are in that condition which is 
called war; and such a war, as is of every man, against every man.... 

Whatsoever therefore is consequent to a time of war, where every 
man is enemy to every man; the same is consequent to the time, 
wherein men live without other security, than what their own strength, 
and their own invention shall furnish them withal. In such condition, 
there is no place for industry; because the fruit thereof is uncertain: 
and consequently no culture of the earth; no navigation, nor use of 
the commodities that may be imported by the sea; no commodious 
building; no instruments of moving, and removing, such things as 
require much force; no knowledge of the face of the earth; no account 
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of time; no arts; no letters; no society; and which is worst of all, 
continual fear, and danger of violent death; and the life of man, soli- 
tary, poor, nasty, brutish, and short. . . . 

It is consequent also to the same condition, that there be no pro- 
priety, no dominion, no mine and thine distinct; but only that to be 
every man’s, that he can get; and for so long, as he can keep it. 


There is a rich philosophical tradition of describing how society could 
evolve from the state of nature; Nozick’s Anarchy, State and Utopia (1974) 
is the most recent well-known contribution to this tradition. Any such de- 
scription answers our first question of why not all people are criminals. 
Obviously, game theory should have much to say about the state of nature, 
and Schotter (1981, pp. 45-51) has already tried to use cooperative game 
theory to derive a peaceable society from this state. We saw in chapter 2 
that cooperative theory ignores many of the questions we want to address. 
However, we will use the framework of Schotter’s “state-of-nature theft 
game” for our analysis. 

In the state-of-nature theft game, then, there are n players, i= 1, 2,...n. 
At the beginning of the game each player receives M units of manna. If 
another player attacks him successfully he loses all his manna. If he attacks 
another player successfully and alone, he receives all that player’s manna. 
Attacking, though, has a psychic cost to him of c < M units of manna. 
Each player also has an option of preparing —at a cost—a defense against 
an attack by any other set of players. If an attack is defended against, there 
is only a §0 percent probability it will succeed. Utility is linear in manna. 

To be precise, a strategy for player i is a pair of vectors (A;, D;) where 


A; = (a;,;), =O! 2a ict lsat 
D; = (d,), JS aaa eee 


with 
> 4, = 1. 
j 


If a; =1, /=1,...,n, then player i attacks player /; if a,, = 1, player i 
attacks no one. Player jis permitted to attack at most one player. Similarly, 
if d;, =1,7=1,...,n, player i prepares a defense against player j. The cost 
of attack for player / is 


n 
eda, =(I—4,)c, 
J= 


and the cost of defense is 
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(X 4,) 
where 6(-) is a real function of the nonnegative integers with 
6(k+1) > 6(k) 
6(k +2)—6(k +1) S 6(K +1) —8(k) 
6(1) >c 


for any nonnegative integer k. Preparing a defense against more attackers 
costs at least as much as preparing a defense against fewer, but marginal 
costs decrease. 

Player i’s gain from attacking player j depends both on player j’s defense 
strategy D, and the identities of the other players attacking player j. Let A; 
denote the set of players against whom player j is defending, and let ©, 
denote the set of players who are attacking player /: 


A; = {k|dq, =} 
®, = {kl a; =1}. 


If A; 1 @ = 9, then the attackers in @, meet no defense and split all 
of player j’s manna among them. Each gains M/|@,|. When A; M @, 
is nonnull, how much each attacking player receives depends on which 
players attack successfully. If player i is not being defended against, 1.e., if 
a ®, =A fh) ®), then his expected gain is the expected value of 


eee eee 
|®, = CA; N®)| F |(A; + @),| 


where |(A; + ®), | denotes the number of defended against attackers who 
succeed in their attack on j. This is a random variable, with 


[Ane (08) 


Prob {|(4, 1 ®)| =} = (1/2) : 
that is, |(A; © @,),| has a binomial distribution with parameter |. Thus 
for i € @, — (A; N ©), the expected gain is 
(3.99) 


[4,8 


|AN®| 
dais x [® (a, NG) ti © 


The expected gain for i €(A; M @)) is half as great, since there is only half 
the chance of his attack succeeding (but if successful he needs to consider 
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only the other members of (A; ™ @,)). Thus we may write the payoff 
function for the state-of-nature theft game as: 


f(A, D) = M—{(1 —ap)e+6( % d,)} 
= 


|4N®| 


+9M XY (a/I@l)+M YY  ay(1/2) x 
JEX JEX 


jEVA. D) jEVA.D) 


}4N®B| 


oe) 


» {®—(a,n®) +1 


|4,N®| +1 


+M > aj,(1/2) x 


jes! 


sri ag ze 
= | —(A,;N®)| +14! 


as ee II (1 —'ha;i) II (I — a;i)}, 
je, ié\ 
where 
V(A, D) = {j|A; 0 ® =} and 
Ni = {id =1}. 


The first term in curly brackets is the cost to 7 of the strategy he adopts, the 
second term in curly brackets is his expected gain from attacking, and the 
third is his expected loss from being attacked. 

As Hobbes reasoned, all NEs of this game involve genera! warfare. To see 
this, note first that a situation is not acceptable to player if he is defending 
against a player who is not attacking him. For if d;; = 1 and a;, = 0, player 
ican reduce defense costs by setting d;; = 0. Hence at all acceptable situ- 
ations for i: A; C @,. Now suppose A, C ©,, that is, there is some attacker 
against whom / is not defending. Then /’s loss is total, no matter how many 
other players he is defending against. Thus if there is one attacker against 
whom / is not defending, it makes no sense for i to defend against any other 
attacker, since such defenses are costly but do not reduce his losses. Thus at 
any acceptable situation for i, 


Either A; = @,, or 
A, = 6. 


Player i defends against all attackers or none. 
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Suppose now that at an NE both players j and k are attacking player i. 
There are (n — 2) players other than j and k; since each of these players can 
attack at most once, these players together can attack at most (nm — 2) 
players other than 7. But there are (m — 1) players other than jin the game. 
Thus at least one of these players (possibly j or k) is not being attacked. Let 
/ #i denote the player not being attacked, and assume / ¥/ w.l].o.g., since if 
/ =j we can interchange the names of players k and j. Player j’s gain from 
attacking 7 is at most M/2, since player k is also attacking and i defends 
against both or neither (if i is defending, player j’s gain is M/4 < M/2). 
Since / is not attacking /, d); =0. Thus if 7 changes his strategy and attacks 
/ instead of i, he will gain M instead of something not greater than M/2. 
Attacking 7 is not acceptable to j, and we have contradicted our supposition 
that we are at an NE. 

Thus at an NE | @,| < | for all i, and the number of players being 
attacked is the same as the number of players attacking. 

If M/2 > 6(1), all attacked players are defending against their attackers 
(and only their attackers) and receiving a final payoff of M — c — 6(1); if 
M/2 < 6(1), none are defending and their payoffs are M — c. 

Once again, suppose we are at an NE with player i not attacking anyone 
(a;, = 1) and player j * i not being attacked. Then d;; = 0 and player i can 
improve his payoff by M — c > 0 by changing his strategy and attacking /. 
Thus such situations are not acceptable to 7. We cannot have NEs where 
more than one person is not being attacked, we cannot have NEs where 
more than one person is not attacking, and we cannot have NEs where the 
person not attacking is different from the person not being attacked. 

Suppose, however, that //2 > cand player i is neither being attacked 
nor attacking. Then d;; = 0 for any j ~ i. Let k be attacking j, and let i 
contemplate attacking 7 as well. If M/2 < 6(1), then j is not defending 
against k, and attacking j will gain player i M/2 at a cost of c. Thus player i 
is better off attacking 7. If M/2 > 6(1), player 7 is defending against k and 
attacking / will gain player 77/4, M >'/ M >c. So in either case not attack- 
ing j 1s not acceptable to i. 

Hence if M/2 > call players must attack and be attacked at an NE even 
though all would be better off in a state of peace; if M/2 < c, one player 
may be exempt from the carnage. 


II 


What peaceable commitment equilibria exist for the state-of-nature theft 
game? Answering this question is the same as finding out what types of 
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social contract are viable. We will consider four types of commitment pat- 
tern in this section. 
The first is an absolute renunciation of violence 


(Vi)gfC)=fFC) if a, =0 
= 0 _ otherwise. 


No equilibrium can be associated with this commitment pattern. Player i’s 
possible set with this commitment pattern consists of the situation where 
no one attacks anyone else (“peace”) and the situations where i attacks 
one other player (with no other players attacking). If M/2 > 6(1) the 
attacked player in the latter situations is defending and player i’s gain is 
M/2 —c> M/2 — 6(1) >0. If M/2 < 6(1), the attacked player is not 
defending and player i’s gain is M — c > 0. In either event, the peaceable 
situation is never good; in all situations in player i’s good set he is the only 
player attacking. Similarly, in all situations in player j’s good set player / is 
attacking and player i is not. Thus there can be no agreement. 
Next, consider the “Hammurabi commitment pattern”: 


(Vi) gf) =f) if Aj>0 with a,=1 and a, =0 
= 0 otherwise. 


“I won't attack you if you don’t attack me,” is what each player promises in 
this commitment pattern. For certain values of M, c, and 6(-), peace is an 
equilibrium with this commitment pattern (thus we can say that for these 
values the Hammurabi pattern is a possible form of the social contract); 
otherwise there is no equilibrium. 

To see this, consider player i’s possible set, and divide it into three sub- 
sets. The first subset consists of all possible situations in which a,, = 1. In 
all these situations no one is attacking player i—because of the Hammurabi 
commitment pattern attacking a nonattacker is not acceptable to any player. 
In the situations in this subset where i’s payoff is greatest he will not expend 
any energies on defense; thus 


fi =M (1) 


in these situations. Note that one of these situations is peace. 

The next subset of possible situations is those with a,; = | for some j >0 
and a,; =0 for all k # i. No / ¥/ attacks i in any of these situations since 
a;, = 0 and j attacks no k # i since a,; = 0. First, suppose M/2 > 6(1). 
Then j defends against i. Since M/2 > 6(1) > c, j will attack i, even if i 
defends against j. Since M/2 > 6(1) the situations in the possible set where 
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i defends against 7 are better for i than those where he does not. Thus if 
M/2 > 6(1), player i’s maximal payoff in this portion of his possible set is 


fr = M—c—6(1)+ M/2—M/2=M-—c—S6(1)<M. (2) 


Next, suppose c << M/2 < 6(1). Then in the possible set j does not defend 
against i. Since M/2 > c, j will still attack i, even if i defends against him. 
Since M/2 < 6(1), the situations where i does not defend are better for him 
than the situations where he defends. Thus, player i’s maximal payoff in 
this subset, given c << M/2 < 6(1), is 


fi = M-ct+M-M=M-c<M. (3) 


Now suppose M/2 < c < 6(1). Again j does not defend against 7 in the 
possible set. In those situations in the possible set where i defends against /, 
j does not attack and i’s payoff is 


fi = M-c—-6(1)+M=2M—c—Sd(1)<M (4) 
since 

M = 2(M/2)<2c<c + 6(1). 
In those situations where i does not defend, j attacks and i’s payoff is 

fi = M-c+M-M=M-c<M. (5) 


From (2), (3), (4), and (5), then, we can see that no matter what the relative 
values of M, c, and 6(-) are, the greatest payoff for 7 in this subset of his 
possible set is less than M, his greatest payoff in the first subset. Therefore 
there will be no good situations in the second subset. 

The third and final subset of possible situations consists of situations in 
which a;; = | and a,; = 1 for some k # i. First, suppose that 


M/4 > 6(2) > 6(1) > «. (6) 


Then in the possible set 7 defends against both k and i. Player j may attack 
either k or i without violating his commitment, and since M/2 > c he will 
attack one or the other in the possible set, even if they both defend against 
him. Since M/2 > 6(1), there are no situations in the possible set where j 
attacks k and k does not defend (such situations are not acceptable to x ). If 
d;; = 0 and j attacks k, then, since k defends, j would be better off attacking 
i. Hence situations with a; = 1 and d;; =0 are not in the possible set. Then 
the only possible situations with d;; = 0 have a,, =0 and hence a,;; = 1; so 
i’s payoff is 


fi = M-c—M+34M =3h}M-—c<M. 
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If d;, = 1 and d,,; = 1, then / is indifferent between attacking & and attack- 
ing i. Situations where he attacks i, however, are not acceptable to k, since 
he is defending needlessly. If j attacks k, however, player i’s payoff is: 


fi = M-c—6(1) +34M ="4M—c— (I). 
This payoff will be larger than M iff 

%M > c+6(1) (7) 
which is not inconsistent with (6). If 

6(2) > M/4 and M/2>6(1)>c (8) 


then j does not defend. All other considerations remain the same, and 
player i’s payoff in the possible situation where / attacks k is 


fi = M—c—&(1)+ M/2 = 32M—c—A(1) 
which is greater than M iff 

M/2 >c+4(\). (9) 
If 

6(1) > M/2, (10) 


then 6(2) > M/4 and in the possible set ; does not defend. Player / will 
attack either & or i. Player & will not defend in the possible set, even if / 
attacks him. Hence attacking k is acceptable to / even if i does not defend. 
In such situations 


fi = M-c+M/2=32sM-c 
which is greater than M iff 
M/2 >. (11) 


Thus player i’s good situations will be in the third subset of his possible 
set if either (6) and (7), or (8) and (9), or (10) and (11); otherwise they will 
be in the first subset. But if player i’s good set is in his third subset, every 
other player’s will be also, since (6)—(11) make no reference to i. Then there 
will be no equilibrium, because everyone will want to be an unattacked 
attacker, which is impossible. If, on the other hand, player i’s good situa- 
tions are in the first subset, then every other player’s will be too. Each good 
set will have many members, but for every player the situation of peace will 
be in the good set. Thus peace will be an equilibrium. It will be in fact the 
only equilibrium, since in all situations in every player’s good set he is not 
attacking. 
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Therefore, there will be an equilibrium with the Hammurabi commit- 
ment pattern if and only if neither (6) and (7), nor (8) and (9), nor (10) and 
(11), and the equilibrium situation will be peace. 

How restrictive are the requirements of (6)—(11)? Consider a small ex- 
ample. Let c=1, 6(1) =3, and 6(2) =5. Then the Hammurabi commit- 
ment pattern will have an equilibrium iff 8 = M = 6. Private vengeance is 
not a very effective system. 

A more effective variant is the “pariah commitment pattern”: 


(Vi) giC)=f if Ajla,;=1 and a=! 
= 0 otherwise. 


Each player promises not to attack peaceable players, but makes no promise 
for any player who attacks anyone. In many respects this is a meddlesome 
commitment pattern; however, it will almost always have a peaceable equi- 
librium. 

Once again we will proceed by considering three different subsets of 
player i’s possible set. In the first subset a;, = 1. In these possible situations 
no one will attack 7, and in the best of these situations i will not defend and 
so his payoff will be M. One of the possible situations with this payoff is 
peace. 

In the second subset we have a,; = 1 and a;, = 1. Since a;, = 1, a,; =0 
for all A ¥ i, in i’s possible set. 

If M/2 > 6(1), player j will defend against player i’s attack. Since 
M/2 > c, it will be to player j’s advantage to attack 7, even if i defends, as 
long as no other player is attacking 7. Since this would contradict our hy- 
pothesis of a,, = | in the possible set, we know that at least one player will 
be attacking player i. If at least one player is attacking i, i’s loss from the 
attack will be at least M/2, even if he defends. Since his gain from attacking 
jis only M/2, and there is a cost to attack, and possibly to defense, player 
i’s payoffs in this subset will all be less than M. 

If 6(1) > M/2 >c, then / is not defending. Since M/2 > c, still, at least 
one player will attack 7. Whatever defense strategy player i adopts, it cannot 
reduce his losses, compared with the strategy of no defense at all, by more 
than M/2. Since any defense strategy (other than no defense) costs at least 
6(1), player i’s payoffs are greatest when he has no defense. Then his loss 
will be M, just offsetting his gain, and his payoffs in this subset will always 
be less than M. 

If 6(1) > c > M/2, player j will still not defend. If player i does not 
defend, he will be attacked by at least one player and his payoff will be 


fi = M-c+M-M=M-—cK<M. 
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If he defends against g, = | possible attackers (note that for-acceptability 
to j given no other attackers, he must always defend against /), then his 
payoff cannot exceed 


2M —c—6(q;) < 2M—c—A(l) < M. 


In the third subset of player i’s possible set we have a;, = | and a,, = 1. 
Since both i and / are attacking, other players can attack them without 
violating their commitments. 

First let us consider the situations (if any) in the third subset where 
neither 7 nor j defends against any attackers. Then 


M 
fi, = M—c+——-M<M 
|®| 


since |@| = 1. 
Next consider the situations (again, if any) where both defend against all 
attackers. In these situations 


Bl -! |®|-1 

fi = M—c+Mci/2)2! > (1/1) (hay ) 
~ Mtl -(1/2)'*'7-6(|@}) 

\®\-1 |®| -1 

= M+ Mya) y al) Le. 


+(1/2)'! -it ~6(|®|). 


Thus f; is negatively related to both |@,| and |@,|; hence /; in these 
situations can never be greater than f; when |@,| = |@,| = 1. But if 
|@,| = |@,| = 1, the term in curly brackets vanishes and we have f; = 
M —c-—6(1) < M. All these situations, moreover, will be better for i than 
situations where he defends against a proper nonempty subset of attackers; 
and there are never any possible situations where j defends against a proper 
nonempty subset of attackers (for the reasons given in our discussion of 
NEs). These situations are also clearly better for i than those situations in 
which 7 defends and 7 does not. 

Thus the only remaining situations that might be good in the third subset 
are those where i defends (against all attackers) and j does not. In these 
situations 


fi = M—c—6(|@|) +M/|®| — Mei —a/2)'™] 
= M—c—6(|@|)+ M{1/|@| +(1/2)'®! — 1}. 
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Since |@,| > 1 throughout the third subset, the expression in curly brackets 
will be nonpositive (which will make f, < M) unless |@,| = 1. But sup- 
pose |®,| = |. For such a situation to be acceptable to 7, we need M/2 < 
6(1); otherwise player j would be better off defending against i. But since 


|@,| = 1, 
M(1/2)'®! < m2 


and 
6(|@,|) = 6()); 
so if |@,| = 1, 


M(1/2)'*! < a(|®|), 
and 
fe = M—c—6(|@]) + MC1/2)'®! <M—c< M. 


Therefore, there are no good situations in the third subset of i’s possible set. 

Finally consider the fourth subset of the possible set—the situations 
where a;, = 1 and a, = 1, k #0, i. The arguments we used for the third 
subset will apply with equal force to all those situations in the fourth subset 
where |@,| = 1; none of them are good. Thus we need only examine 
situations in this subset where no one is attacking i. In all such situations, 
there is either some player / ¥ i who is not attacking anyone, or some player 
l' Ai for whom |@,| => 2. 

Suppose / ¥ i is not attacking anyone and 7 is not being attacked. For 
acceptability to /, we need d;, = 1 and M/2 <c < 6(1). Then 


fi S M—c—6(\A,|) + M <= 2M—c—A(l) < M; 


so these situations are not good. 

Thus we must suppose that every player is attacking, and that at least 
one player is being attacked at least twice. Suppose, in such a situation, that 
some / ¥ jis not being attacked. Then / is not defending against anyone, 
and so anyone who attacks will gain M. But those who are involved in a 
multiple attack are gaining at most M/2. Thus situations where some / # i 
is not being attacked are not acceptable to multiple attackers; they are not 
possible for 7. Therefore we must suppose that every / ¥ iis being attacked 
at least once, and precisely one player is being attacked twice. 

Even these situations are not possible for i if M/2 > 6(1). For if so, all 
players other than i and the player being double-attacked are defending 
only against the player attacking them. Either of the double-attackers could 
expect to gain (3/,) M by attacking any singly-attacked player. Since they 
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are gaining at most M/2 by attacking the double-attacked: player, these 
situations are not acceptable to the double-attacking players; hence they are 
not possible for i. 

If M/2 < 6(1), however, such situations are possible. For then no at- 
tacked player defends, since 


M/4 < M/2 < 6&1) < 6(2). 


The double-attackers gain M/2 and they would gain no more by attacking 
a singly attacked player. A singly attacking player gains M, and can only 
lose by changing his target of attack. Nor can he do any better by attacking 
i. A double-attacking player can gain M > M/2 by attacking / if i does not 
defend against him, but if i defends against both doubly-attacking players, 
neither can improve by attacking him. Since included among these possible 
situations are situations where / is not the double-attacked player, there are 
then possible situations where i’s payoff is 


fi, = M-—c—6(2)+ M = 2M—c—<6(2). 


This is greater than M iff M > c + 6(2) and possible iff M/2 < 6(1). Thus 
this sort of situation is good for i iff 


26(1) > M > c+ 6(2). (12) 


If (12) does not hold, then the first subset— where / does not attack —is 
good for i. Since the situations that are good when (12) holds are not sym- 
metrical with respect to players, none will be good for all players, and there 
can be no equilibrium with the pariah commitment pattern when (12) holds. 
But when (12) does not hold, the situation of peace is the only equilibrium 
with the pariah pattern. 

Comparing (12) with (6)—(11), we see that the range of values without an 
equilibrium is much smaller with the pariah commitment pattern than with 
the Hammurabi commitment pattern. In fact, if we let c = 1, 6(1) = 3, and 
6(2) = 5, as we did with the Hammurabi pattern, we see that any value of 
M will have an equilibrium. In general, linearity of the defense function 6 is 
sufficient to guarantee a peaceable pariah equilibrium. 


Ill 


Hobbes suggests that nation-states may be one means to a peaceable solu- 
tion of the state-of-nature theft game. So does Nozick, who sees such states 
as an outgrowth of “protective associations.” Let us consider, then, a family 
of commitment patterns that divides players into nation-states. 
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We call a representative commitment pattern in this family g*. With 
each commitment pattern g” is associated a different partition 7(g”) of all 
players 

me i= Ai Cy "A Cy yen25 AO. 3-74 comport 

P(g”) 

U [A, UG]=1 

pe 

Axi C, = VP.q 

A,1A,=G,NC, =9 p,q, p¥q. 

We will write A, U CG, = N,, and refer to N, as the (set of players who 
make up the) p-th nation, A, as the p-th army, and C, as the p-th citizenry. 
Thus every commitment pattern in this family is associated with a different 
partition of players into nations, and within nations, into army and citizenry. 
Given any partition 7(g™), a “national” commitment pattern is: 
Fori€G,: g(¢)=fC) if aj=1  forany jEN, (13a) 
or if ai; =1 and Dien, LKeN ax | =0 (13b) 
for any q#p or for any jEN, 


= 0 otherwise. 


Ror7 € A,,. gN(-) = f(-) if a;=1 and Xypey, a, =0 (13c) 
for any j/¢A, 


or if i¢ FA (13d) 


or if a,,—1 and DK e(RSU FA) Aik —i() (13e) 
for any j€A, 
where 


Fy = {k ©G| Zien, &: =0} 
Fi ={k€A,|a; =0 for jE Fy 
and a4; =0 for j€A, if Bere aj, =O}. 


In (13a) each civilian promises to refrain from all attacking within his nation 
p and in (13b) he extends this promise to the nationals of any nation none of 
whose members are attacking any members of nation p. In (13c) members 
of the army promise not to attack anyone outside the army who is not 
attacking anyone in the nation; they promise, in (13d), to be upstanding 
members of the army, that is, members of F pe and they promise in (13e), 
not to attack any army member who does not attack upstanding civilians 
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or army members. Upstanding civilians—members of F,° —are defined as 
civilians who do not attack within the nation, and upstanding army mem- 
bers are army members who attack neither upstanding civilians nor army 
members who do not attack upstanding civilians. 

To see what types of national commitment patterns will be associated 
with peaceable equilibria, we need to examine the good sets of players in 
both A, and C, for some representative nation p. 

First, let i € C,, and consider the subset of i’s possible set where a;, = 1. 
Clearly the best situations for i in this subset would be situations in which 
no one attacks 7 and i defends against no one. But are any such situations 
acceptable to all other players? Not attacking i is always acceptable for 
Jj €G,. Since 2,cy,a, = 0 in this subset, not attacking i is acceptable for 
j €A,. If no one else in N, is attacking anyone in N,, then not attacking / is 
acceptable for all j € N,, for all g ¥ p. If no one in N, attacks anyone in 
N,, then not attacking anyone in N, is acceptable for everyone in N,. Thus 
there are situations —including the situation of peace—in the first subset of 
i’s possible set, in which he is not attacked and does not defend. At these 
situations, of course, f, = M. 

The next subset of i’s possible set that we wish to consider has a,;; = 1, 
j © N, and relative international peace. By “relative international peace” we 
mean that nobody in N, is attacking anyone outside it; hence no one outside 
is attacking anyone in N,. Given international peace, a;, = | for all j € C,, 
and thus it will not be acceptable for any member of A, to attack any 
member of C, except i. Members of A, are not prevented by their commit- 
ments from attacking /, but will they? Since all other members of C, will be 
upstanding, no members of A, will attack any of them; since all members 
of A, will be upstanding, there will be no intra-army attacking. Thus if 
| A,| = 1 there will be at least one member of A, attacking / as long as the 
gain from attacking is greater than c, the cost of attacking. 

If M/2 > 6(1) >c, then player j will defend against ’s attack so that i’s 
gain from attacking will be M/2. Since M/2 > c, at least one member of 
A, will attack i, and i’s loss will be at least 7/2, even if he defends. Thus i’s 
payoff in this subset will be less than M — c. 

If 5(1) > M/2 > c, then player j won't defend and i’s gain from attack 
will be M. If player i defends against all those attacking him, he will lose at 
least M/2: 


fi = M-c+M-—M/2-6(|@]) 
= M—c+M/2-8|®@]|) < M—c 


since 
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8(|@,|) = 6(1) = M/2. 


If player i does not defend against some player attacking him, his loss will 
be M, and clearly his payoff will be less than M. 

If 5(1) > c > M/2 and player i defends against every member of A,, 
none will attack him, and his payoff will be 


f, = M—c+M—8&(|A,|) < 2M—c—6(1) < 2M—2(M/2) = M. 


If player i does not defend against some player in A,, that player will 
attack him and his payoff will surely be less than M. Thus, as long as 
nation p is at international peace, no situations are better for 7 than those 
in which a;, = 1. 

In the third subset of player i’s possible set we have a;; = 1, 7 © N, and 
war between N, and N,. By war, we mean that there is some k € N, 
attacking k’ € N, and / € N, attacking /’ € N,. Then anyone in N, can 
attack anyone in N, without violating commitments, and vice versa. Then 
the | N,| +|A,| players in N, U A, can all attack i; the players in N, can 
also attack any other player in N,; the players in A, can also attack any 
other player in N,. If |A,| > |N,|, then surely there will be a member of 
A, to attack i and the same analysis as the second subset applies. Similarly, 
if |N,| 2 |N,| there will be a member of N, to attack i. 

But if 


Neel =>" |NG| = TAL, (14) 


there is a situation in i’s possible set where every member of A, is attacking 
a member of N,, and every member of N, is attacking a member of N, 
other than i and /. If //2 > 6(1), all players being attacked defend. Then it 
would be better for any attacker in A, U N, to switch to attacking / if 7 is 
not defending against him. Hence if i defends against all, he is not attacked 
and his payoff is 


Wiel = O(\A,)| | NG de pe 
which is bigger than © iff 


M2 > 620(|Ay\|\-F |.NG i): (15) 
Note that (15) implies 7/2 > 6(1). 

If 

M/2 < 6()) (16) 


then no attacked player defends. Since i need not defend either: f; = 


192 APPENDIX A 


2M—c> M. So the first subset won't be good for i if (14) and either (15) 
or (16). 

For those situations with more complicated international wars the same 
sort of reasoning holds. If N, is at war with both N, and N,, but N, and N, 
are not at war with each other, | N,| + | N,| replaces | N, | in (14) and (15): 


IN,1-1 > INZI +11 = 14,1 (14a) 
M/2 > c+6(|A,| +|N,| +141). (15a) 


If N, is at war with both N, and N, and they are at war with each other, we 
have 


IN, =o > | AG ee eas (14) 

M/2 > c+6(|A,| +|N,| +11). (15b) 
If a;, = 1,7 © N,, we similarly have 

|No| > 1A, | (14) 
and 

M/2 > c+6(|N, |) (15c) 


with similar expressions for more complicated wars. 
Thus, if a;, = 1 in the good set for all i, then (14abc) and either (15abc) 
or (16) cannot hold. Sufficient conditions for this result are: 


(CS-1) There is only one nation 

(CS-2) There are two nations with equal populations 

(CS-3) oc + 6(min (|A,| + |N,|)) > M/2 > 6(1). 

pA 

Now let us consider the good set for i € A,. 

In the subset of 7’s possible set with a,, = 1, we have, as usual, the 
situation of peace, and other situations with f, = M. 

Next consider the subset with a;, = 1, 7 © N, and relative international 
peace. Then in the possible set C, = Fy and A, — {i} © F,4; thus 
j€(F, U F8). Since then 


a, = 1, 
kKE( FS UF") 
no other member of A, is prevented by his commitment from attacking i. 
Nor is there any other player for any other member of A, to attack. Thus as 
long as | A, | = 2 we will be able to use the same sort of reasoning we used 
in the second subset of the possible set for i € C,, and f, < M. If |A,| =1, 


of course, there will be no equilibrium: “Quis custodiet ipsos custodes?” 
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has an answer (“custodes ipsos”) but “Quis custodiet ipsum custodem?” 
does not. A necessary condition for equilibrium to exist is: 


VAbia== 2 «forall sp. (17) 


Now let a;; = 1, 7 © N,, and suppose there is war with N,. By the same 
sort of reasoning as before, some of these situations will be good if 


rete PNET = PAL 1 (14d) 
and either 

M/2 >c+6(|A,| +|N,| —1) (15d) 
or 

M/2 < 6()). (16) 


For simultaneous war with N, and N, who are not at war with each other, 
we have: 


ieee Le? WINE [et ING et Arlt (14e) 

M/2 > c+6(|A,| +1N,| +1N] —, (15€) 
and when N, and WN, are at war with each other: 

AE vee | NG | see ANG Lip == AT el (14f) 


and (15e). 

When a;; = 1, 7 © N, and war only between N, and N,, we have (14c) 
and (15c), just as with i € C,. 

Thus we see that the three conditions we set forth above for well-behaved 
good sets for i € C, are also sufficient for well-behaved good sets for i € A, 
as well, provided (17). Thus if 


|A,| 22 forall p (17) 
and either 


(S-1) There is only one nation; or 
(S-2) There are two nations with equal populations; or 
(S-3) ¢ + 6(min (|A,| + |N,|)) > M/2 > 6(1); or 
P.q 
p¥q 


(S-4) N, =A, forallp 


there will be a peaceable equilibrium with a national commitment pattern. 
Thus there is a national commitment pattern that will be associated with an 
equilibrium for every M, c, 6(1). 
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Our results, particularly (S-2) and (S-3), are considerably more encour- 
aging to the formation of large numbers of nations, even in the same geo- 
graphic area, than Hobbes’s, Nozick’s or Schotter’s. 


IV 


We have seen three types of commitment patterns— Hammurabi, pariah, 
and national—that are sometimes associated with peaceable equilibria. 
Thus we have made great progress on our first question: why isn’t every- 
body a criminal? We have made no progress on the second question: why 
are some people criminals? The peaceable equilibria we have found have 
no crime whatsoever —a rather poor description of the real world. Is there 
some way, then, we can modify the commitment patterns to produce equi- 
libria with some crime, but not the war of all against all? 

Working in the realm of pure strategies, we have not been able to obtain 
any encouraging results. The most natural way to introduce crime would 
seem to be to modify the commitment patterns so that a small number of 
amoral “rascals” are making no commitments whatsoever. We would hope 
to find that if the number of rascals is small enough there will be equilibria 
with some crime but without bellum omnium contra omnes. Unfortunately, 
however, we find that for each of our three original commitment patterns, if 
there is even one rascal the only equilibrium situation is bellum omnium 
contra omnes. 

Consider first the family of “rascal-fied” Hammurabi commitment pat- 
terns: 


For i€R gr4(-) =0 
For i¢R gf" (-)=f(-) if Ayla, =1 and a, =0 
= 0 otherwise. 


Goodness for nonrascals can be dealt with quickly. Symmetry among 
nonrascals means that no situation where rascals are attacking some but 
not all nonrascals can be agreed upon. If rascals are attacking all nonrascals, 
then we have bellum omnium contra omnes, which we are attempting to 
avoid. Thus we need situations with a,, = 1, for all i © R (the set of 
nonrascals), and a;; = 0, for all 7 © R,i€ R. But by our previous discussion 
of the Hammurabi pattern, we know that such situations will be good for 
i € R only if M/2 > 6(1), which we must therefore assume to be the case. 

On this basis let us consider goodness for i € R. First consider the subset 
of i’s possible set where a,, = 1. Then in this subset a,; = 0 for 7 € R. If, as 
is possible, the other | R| — | members of R are attacking each other, one 
on one, then there will be no one to attack i. But since M/2 > 6(1), all 
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players being attacked will defend; hence to avoid attack player i must 
defend against all other rascals: 


f; = max (0, M—8(|R| —1)). (18) 


The next subset has a;, = 1, 7 © R, and a,; = 0 for k # i. Then again 
a,; =0 for k € R. Player jis attacking either Ror R. If j attacking in R is 
good for i, then agreement with R and hence equilibrium is impossible. So 
suppose j attacking in R. Aside from i, there are | R| — | other players in 
R. If none attacks i or j and none double attacks, then there are only 
|R| — 2 targets for attack in R. Thus it will be better for i if one of the 
other rascals attacks in R; this frees him from counter attack and gives him 
payoff: 


f, = max (M/2 —c,3;M—c—6(|R| —1)) 


which is always greater than the payoff of nonattack in (18). Thus it will 
always be good for i € R for some rascal to attack in R; agreement with R 
is impossible, save in bellum omnium contra omnes. 

Now consider the rascal-fied pariah commitment pattern: 


For i€ R gf) =0 


For i€R g@(-)=fi-) if Ajlaj;=1 and a, =1. 
= 0 otherwise. 

Since rascals will always attack, it will always be acceptable for some non- 
rascal to attack a rascal. But then it will be acceptable for any other non- 
rascal to attack the nonrascal who is attacking a rascal—and so we proceed 
in domino fashion until all players are attacking. Bellum omnium contra 
omnes is thus the only NE with the rascal-fied pariah commitment pattern. 

Finally, consider the rascal-fied national commitment pattern, and for 
simplicity suppose there is only one nation: 


Fori€R g*(-) =0. 
Eorwiee 2 ()— 7) if 3j|a,;=1 
=0 otherwise. 
Fori€A gf (-) =f;(-) if Ajla;=1 and Lypevay =0 
for j GA 
orif i¢ F4 
orif Jj] a, =1 and Yyercur+a, =0 
ye ee 


= 0 otherwise. 
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In situations acceptable to the rascals, they will be attacking somebody 
and hence, in situations acceptable to the army, the army will be attacking 
the rascals. In situations good for civilians, rascals will be attacking each 
other or the army, and in particular, since army members will be attacking 
some rascals, some rascals will attack army members. In situations good for 
army members, though, no rascals will attack army members—they will 
attack civilians instead. Thus no agreement is possible. 


Vi 


Thus our three commitment patterns for the state-of-nature theft game pro- 
vide no explanation for the existence of crime in a civilized world. Perhaps 
there are other commitment patterns that might perform more effectively; 
this approach, however, does not seem particularly promising. Enriching 
players’ strategy sets by including purely punitive variables that let a player 
do harm without gaining anything himself and by allowing interplayer pay- 
ments could be one fruitful alternative; modern criminal justice systems are 
operated by individuals who are paid to threaten to harm people and derive 
no benefit from the harming. Or we could create enough economic inter- 
dependence to allow enforcement by boycott, as prescribed by the Brehon 
code. Eliminating symmetry among players might also help. 

The most parsimonious approach, though, is simply to allow mixed 
strategies in the basic state-of-nature theft game. Such an approach will 
also explain the high degree of randomness that seems apparent in criminal 
behavior. 

Let us illustrate with an example in the two-player state-of-nature theft 
game. In the two-player game, all three of the pure strategy commitment 
patterns we studied in detail are identical. To be concrete, let 


M=10 
c=2 
6(1) = 3 


and let each player i = 1, 2 have four pure strategies: 


1. Attack the other player and defend against him. 
2. Don’t attack, but defend. 

3. Attack but don’t defend. 

4. Don’t attack and don’t defend. 


A mixed strategy for player | will be a probability vector (x;), 7 =1,...,4 


0: 
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where x; represents the probability that player | will choose strategy /. 
Similarly, (y;) will represent a mixed strategy for player 2. 
The pure strategy payoff bi-matrix for this game is 


Player | 


and thus the payoff functions are 


fi@y) = Sxy, + 10x,y, 


=r) Beye 
ap SReyy, 


hy) = 5xyn 
sts LOX> iy; 
ain LOX iy; 
ae leap gay 


5xi)i 


+ 10x; y, 
ar) See 


+ ++++4+ 4¢4+4 


7X7 V2 
13x; y, 
10x, > 


2x1 V2 
7X2V2 
2x32 
8X4)> 


2x, Y2 
3X7 V2 
2x32 
2X42 


+ 
+ 
— 


+++4+ +444 


Player 2 





10x, y; + 15x, y4 
Dein 
8x;,y, + 18x3y, 

lOxs ys 


Seas 
13x,y; + 10x), 
8x3 )3 
18x,y3 + 10x44 


3x1 V3 
Span ae lbs 
8x33 
8x,y; + 10x,, 


where use has been made of the equality 


3 
Ie =1— >, 9; 


j= 
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Consider the following family of commitment patterns: 


g(x,y) =fAl(x%y) if x+x,>a and y,t+y,S8 
= 0 otherwise 


2.(xy)=A(xy) if y,+ty,>B and x1+xySe@ 
= 0 otherwise, 


where a, B < .5. This commitment pattern is like the naked trade pattern, 
except that the subjects of the promises are probabilities of attack, not 
quantities of goods. We will show that there is a civilized but not crime-free 
equilibrium with this commitment pattern. 

First we will need to find the situations that are acceptable to player 1. In 
doing so, we will need to consider the partial derivatives of player I’s payoff 
with respect to his strategies, and denote them specially: 


of, /ax, = Sy, + 10y, + 10y; + I5y, 
= Sy, + 10(y. + y3) + 15(1 —y, —y2 — ys) 
15'— 10y, — 52+ y;) = G0) 


Of; [0x2 =. 2y, Tye + ayy TU 3 ee 
=7 —35( +33) = Q2,(y) 


Of, /Ax3 = 3y, + 13y, + 8y; + 18(1 —y, —y2 —ys) 
= 18 — 15y, — Sy, — 10y, = Q,(y) 


af, /Ax, = 10y, + 10 — 10y, = 10(y, + ys) = Q,(y). 


It is easy to see that O,(y) > 0 forany 7 #4 and Q,(y) 20. 


Q:(y) — Q2.(y)= 15 — 10x, — SC. +3) — 7 + SC Fs) 
— 80 Oat) 0 


Q:(¥) — Q4(y)= 15 — 10y, — 5(y2 + y3) — 10 + 10(, +5) 
=5 — 5y,+ 5p; 20 


Q3(y) — Q2.(y)= 18 — 1Sy, — Sy. — 10y; — 7 + 5(n Fs) 
= 1) — 10y,—5)7 — Syn 0 


0;(y) — Q,(y)= 18 — 15y, — Sp, — l0y; — 10 + 0G pa 
= 8 — 5y,— 5y, > 0. 


Thus 


O,(y) > Q.(¥) 
Q.(v) 2 Q,(y) 
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Q3(y) > Q2(y) 
Q;(y) > Q,(y) 


always. 
There are two major parts to player |’s acceptable set, and the first part 
has several subparts: 


Case1. If y, +; > B, then clearly x, = x, = 0 in acceptable situa- 
tions for player 1. 


Case ta. If Q,(y) > Q;(y), then x, = 1, x, =0. 
In this subcase we have: 


O,(y) = 15 — 10y, —5(2 + y3) > Q3(y) =18 — 15y, —S5y2 — 10y; 
Sy, == Sy => 3 
Jy TVW; = 6. 


Case 1b. If y, — y; = .6, then Q,(y) = Q3(y) and x, + x; = | in player 
l’s acceptable set. 


Case Ic. If y, — y; <.6, then Q,(v) < Q;(y) and x, =0, x; = 1. 


Case 2. If y, + y; S B, then no situation with x, + x; >a will be 
acceptable to player 1. Acceptable situations are those that include solu- 
tions to 


max Ay) 


S.t. Six; =] 


i AP oe SSO 

First-order conditions include 
aL/ax, = Q(y) tA, +A, SO 
0l/dx. = Q,(y) tA, SO 
dL /dx, = Q3(y) +A, +A, SO 
dl /dx, = O,(v) + A, SO 


where A, refers to the first constraint and ), to the second. Since for all y, 
Q,(y) and Q;()) are greater than Q,(y) and Q,(y), A, will always be 
negative and hence: 


Xx, Fx, = a. 
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Now suppose Q,(y) = Q,(y). Then 


7—5(y, +y3) 2 10—10(), +93) 
Vi + y; = 6. 


But 
Vite pie 


in this case. So we need Q3(y) < Q,()). 

Similarly suppose Q,(y) = Q;(y). Then », — y; = .6. But y, 20 
implies y, = .6, which also contradicts the hypothesis of this case. 

Then we must have Q,(y) < Q,() and Q;(y) < Q;(¥). 
Thus acceptable situations for player | will have 


xX; =a, x =1l—a, x, =x, =0. 


Now let us find what situations are good for player 2. Player 2’s possible set 
is player l’s acceptable set; thus good situations for player 2 are merely those 
situations in player 1’s acceptable set where player 2’s payoff is greatest. 

In case 1-a of player I’s possible set, x, = 1, x. =x, =x, =0,y, +); > 
B, ¥, — 3; > .6and player 2’s payoff is A(x, vy) = Sy, + 2y, + 3y;. This 
payoff is greatest when y, = 1, and its value then is 5. 

For case 1-b we have x, + x; = 1, y, + y; 2 B, yy; — y3 = .6 and 
xX, = x, = 0. The payoff to player 2 is 


AQ yY) = 5x, y, +2x, y. £3x,y, + 10x, 9, +2x,y. + Skee 


= 5x, y; +2x,y2 +3x,(), —-6) + 1001 =X), 
+ 2(1 cae, 5 v2 + 8(1 IX Avy 7.6) 


= —4.8 — 10x, y, +3x, -F18y, + 2y3, 


and so player 2’s greatest payoff is at the situation y, = .6, y, = .4, x, = 1, 
x; =»; = 0, and its value is 6.8. 

For case I-c, we have x; = 1, y, +y; 2B, y, —¥3 <-6and x, =x, = 
x; =0. Player 2’s payoff in these situations is always less than his payoff in 
the best situation of case I-b; it approaches that value as », approaches .6. 

Finally, for case 2, we have y, + )3 SB, x; =a, xy =1 —a,x, =x = 
0. So player 2’s payoff in these situations is: 

Si(xy) = 10ay, + 2ay, + 8a), 

+ 5(1—a)y, —2(1 —a@) y, +8(1 —a) y; + 10(1 —@) 
= 10(1 —a) +5y,(1 +a) +2y,(2a — 1) + 8y3. 


Since a < .6, y, has a greater coefficient than either y,, or y,. Hence 
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y3 = B, y,; = 0 in the best situations for player 2 in this part of player 1’s 
acceptable set. Since a <.5, the coefficient of ), is negative: y. =0, and so 
ys = 1 — B. Player 2’s payoff is 


10(11—a)+4.8 >68 ifa<.8 
and so the situation 
5b Oy Se SOR AS eS Sek 2 Sas Sa, Sa SD 


is good for player 2 as long as a <.5. 

By similar reasoning, this same situation is good for player | as long as 
B <.5. Thus we have found a set of equilibria, one associated with every 
pair (a, 8B), a, B <.5. One of these equilibria (a = B = 0) is associated with 
complete peace, and in none is there all out war. Since a need not equal £, 
there is no requirement for symmetry: one player can be a criminal and the 
other a saint. Neither wastes resources defending, the probability of no 
attack at all is always at least .25, and the expected number of attacks is 
always less than 1.5. 

Crime picks random targets at random times, and criminals may have 
backgrounds no different from those of law-abiding citizens. But when there 
is agreement on commitment pattern parameters, we will see stable statis- 
tical relationships. 

The mixed strategy theft game, then, can answer both of our basic 
questions about crime, and should be the starting point for more detailed 
analyses. 


B = Games Without Free Disposal 


“Man proposes but God disposes.” 


THOMAS A KEMPIS 


Our theorems about commitment equilibrium have all rested on the axiom 
of “free disposal of utility’—that one can always make oneself thoroughly 
miserable and hence that any commitment pattern g < f is always worthy 
of consideration. In this appendix we will show that eliminating this axiom 
causes only minor perturbations in the theory of commitment equilibria. 


I 


Let us assume that for each player i only those commitments in an arbitrary 
set H, are feasible. We will require that H; include the null commitment if 
it includes no other, but if it includes at least one other commitment it need 
not even include the null commitment. We denote by (/, S, f, H)** the 
game with this arbitrarily restricted set of strategic moves; note that if H, is 
the only null commitment for all i 


Sf HY" = Sf) 
and if H, is all commitments g Sf 
b Sif)" SS PP 


Thus we are dealing with a generalization that encompasses both games 
without strategic moves and games with unrestricted strategic moves. 

For each s € § and i € J denote by O(i,s, H;) the set of allowable com- 
mitments that will make s acceptable to /: 


O(i,s, H;) = {gi € Ai \(f —gi(s)\2U% — gi) (S-i,5;), VS; = Sj}. 


Let g*(-) denote a commitment in O(i,s, H,;) that maximizes player i’s net 
payoff at s: 


(f, —8h)(s) 2 (f, —g:)(s) for all g; € O(i,s, Hj) 
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and let f;*(s) denote that maximal net payoff if O(i,s, H;) is nonempty 


FF (s) = (fi — 85) (s) 


while, if O(i,s, H;) is empty, let f*(s) = —1. Let G(i,s) be the set of all 
g*(-)’s. It turns out that the modified payoff function f* will play a role very 
similar to that played by f in free-disposal games. This similarity will allow 
us to show that all free-disposal equilibria with feasible commitment pat- 
terns are also equilibria in restricted games. 

We proceed by a series of lemmas, several of which mimic and generalize 
our free-disposal results. 

First, though, we need to generalize our definition of commitment equi- 
librium in the obvious way: 


(g,5) is a commitment equilibrium iff 


(a) g; © A; for alli 
(b) se N(g) 
(c) (g,s5) is not beaten by any (g’,s’) where g; € H; for all i. 


Lemma B-1. If (g, s) is an equilibrium, then g; © O(i, s, H;) for all i. 


Proof. Suppose g; ¢ O(i,s, H;) for some i. Then either g; €¢ H; or s € 
A(i, g). If g; € H;, then by (a) in the generalized definition, (g,s) is not an 
equilibrium. If s € A(i,g), then s € N(g) and by (b) in the generalized 
definition, (g,s) is not an equilibrium. & 


Lemma B-2. If (g, s) is an equilibrium, then g; © G(i, s) for all i. 


Proof. Suppose g; ¢ G(i,s) for some i. Then since by Lemma B-1, g; € 
O(i,s, H;), there is a g* © O(i,s, H;) with 


GE) > Fi — 8) )- (1) 
Consider the commitment pattern ¢ given by 

SS 

Bees 


For j # i, A(j,&) = A(j,g) and since by definition of an equilibrium 
s €A(j,g), 5 € A(j, &). By definition of O(-), s € A(i,g). Hence s € N(¢) 
and from (1) 


(Ff: — 8) (5) > (Ff; — 8) (5). 


Thus (g, 5) beats (g,s) through 7. Since g; € H; (from definition of O(-)) 
and g; € H; for all ji, (g,s) is not an equilibrium. @ 
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Corollary (Minimum Real Suffering). If (g,s) is a commitment equilib- 
rium, 


{—-2)@) = 7 


Lemma B-3. (Possible Points). Let (f, — g,)(s) = f,*(s). Then (g, s) is 
beaten through i iff there is an s’ © P(i,g) such that f,*(s') > f,* (s). 


Proof. Sufficiency. Suppose /;*(s’) >/,*(s) for some s’ € P(i, g). Construct 
g’ in the following manner: 


g =g, for j#i 
BT eee 


Since s’ € P(i,g) and A(j,g) = A(j,g’) for j i, s’ © A(j,g’) for all j Fi. 
Since by definition g/ = g*; € O(i,s’, H;), s’ € A(i,g’). Thus s’ © N(g’). 
But 


(fi —ats) =(4-8) 8) = S°°) >) = Gee 
and so (g,s) is beaten through / by (g’, s’). 


Necessity. Suppose ( g, § ) beats (g, s) through i. Either § € P(i, g) or not. 
Suppose not. Then for some j § ¢ A(j,g). Beating through ij requires 
A(j,g) = A(j,&). Thus § € N(g&) which is a contradiction. Thus § € 
P(i,g). Since § € N(g) by the hypothesis of beating, § € A(i, g) and thus 


£, © OS, H;). 
If f*@) =f (s )foralls £ FG 2) 
(ff -&) (6) SH 6) SHS) = (KG — a) 6) 


which means that (g, § ) does not beat (g, s). Thus (g, s) is beaten through 7 
only if there is ans’ € P(i,g) with 


fi*(s’) > f(s). 
a 


Define “extended goodness” as the analogue of free-disposal goodness, 
but with comparisons using /* instead of /: 


B*(i,g) = {s € P(i,g)|(Ws’ © Pli,g)) f*(s) = fi* (sh. 
Then we have an extended goodness result: 
Lemma B-4. (Goodness). (g, s) is an equilibrium iff s © 0; B* (i, g). 
Proof. Sufficiency. Suppose s © , B*(i,g). Then 
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s€() Pig) =1M 1) AGg) = 1) Alig) = N(g) 
i i j#i i 
and by Lemma B-3, (g,s) is not beaten. 


Necessity. Suppose that for some i, s € B*(i,g). Then either s ¢ P(i, g) 
or s © P(i,g). If s € P(i,g), then there is some j # i with s € A(j,g) and 
thus s € N(g) and (g,s) is not an equilibrium. If s € P(i,g), then there is 
some s’ € P(i,g) with f;*(s’) > f;*(s); hence by Lemma B-3 (g,s) is 
beaten through / and is not an equilibrium. # 


Theorem B-1. (Extension). If (g,s) is an equilibrium of (I, S, f)* and 
g; © H; for all i, then (g,s) is an equilibrium of (I, S, f. H)**. 


Proof. Since (g,s) is an equilibrium of (J, S, f)*, 
g(s) =0 (2) 


by the No Real Suffering Theorem. Moreover, s © N(g) and hence s € 
A(i,g) for all i. Since g; © H; for all i by hypothesis, this means that 
g; © O(i,s, H;) for all i. From (2), then, 


f(s) = f*(s). 
Thus for all i and all s’ € P(i,g) 


wey — 76) = 7ey=% 6) 


where the first inequality follows from goodness in (J, S, f)* and the second 
from the nonnegativity of commitments. Thus s € B*(i,g) for all i and by 
Lemma B-4, (g,s) is an equilibrium of (J, S,f, H)**. & 


In general, the converse of the Extension Theorem is not true because we 
have no means of preserving under /* the ordering of situations under f. 
This is because we have placed no limits whatsoever on the commitment 
restrictions H. When we limit H to one of two broad classes—and I can 
think of no plausible type of H that does not fall into these two classes — 
we can achieve considerably stronger results. 


II 


Therefore let us consider as the first class those commitment restrictions 
without “situation-interdependence.” By this we mean that each g,(s) is re- 
stricted to lie in a set H;(s) no matter what values the other parts of the 
player’s commitment take. We assume without loss of generality that every 
H,(s) includes zero—otherwise the payoff function could be reduced by the 
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amount of the smallest feasible commitment—and, to facilitate argument, 
that it includes some maximum value h,(s). 

Restrictions without situation-interdependence lead to particularly tract- 
able forms for g* and f*. To be specific suppose that O(i,s, H,) is non- 
empty and contains some feasible commitment g;,. If g;(s) # 0, consider 
g,(*) where 


&(s) = 0 

&(s’) = g,(s’) 
for s’ # s. Since s € A(i,g), clearly s € A(i,g) and since g; © H,, g; © 
O(i,s, H;). Thus g*(s) = 0 and f;*(s) = f,(s) if O(i,s, H,) is nonempty. 

How can we tell whether O(i,s, H;) is nonempty? It will be nonempty if 
there is no feasible commitment that will make s acceptable to i, and there 
will be no such commitment unless the commitment where we subtract as 
much as possible from each situation (5;, s-;), §; #s,, and as little as possible 
from s makes s acceptable. If this commitment does not “do the trick,” no 
feasible commitment will. Thus O(i,s, H;) will be nonempty iff: 

Sis) 2 (Ff, —hi)(G;,5-) for all &; € S;. 


We denote by R(i, H;) the set of situations where this inequality holds for i 
(they are “reachable”) and by R(//) the situations that are reachable by all 
players: 


R(H) = ()R(i, Hi). 
We can then summarize the f* matrix: 


f'($)=fAG) 7 serge) (3) 
= —I1! otherwise. 
Thus we have: 
Lemma B-5. If (g,s) is an equilibrium of the game (I, S, f, H)** where H 


is not situation-interdependent, then s © R(H). 


Proof. Suppose s ¢ R(i, H;) for some i. Then for every feasible g, s €¢ 
A(i,g). Then s € N(g) and so (g,s) is not an equilibrium. 


Lemma B-6. (No Real Suffering). If (g,s) is an equilibrium of the game 
(1, S, f, H)** where H is not situation-interdependent, then 


g(s) = 0. 


Proof. From the Minimum Real Suffering Corollary to Lemma B-2, f(s) — 
g(s) = f*(s). From (3) and Lemma B-s, f*(s) = f(s). Hence g(s)=0. 
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Theorem B-2. (Individual Rationality). If (g,s) is an equilibrium of the 
game (I, S, f, H)** where H is not situation-interdependent, then 


Ey a ae SiS§;58-:) for all i. 
Proof. By arguments identical to those in chapter 5, but using Lemma B-3 
instead of Theorem 2, we obtain 
jr ey = max min I G82): (4) 
Now consider the situation (or situations) s* which we define as: 
s* = (s/,s%) = arg max min f8;,5-1). 
By definition of a maximum 
es (5;,87)  fonalloSners, 
and hence s* € A(i,0). Since 0 € H;, s* € R(i, H). From (3), then 
KG") = fi(s*) 
or 


Ss 


max min f,*(§;,§_;) = max 
5,ES 


in f,(S;,5_;)- 
§,ES, ess ES, Fil i> i 


and from Lemma B-6 
fi*(s) = fils). 
Substituting in (4), we have 
> in £.(5,.8 
jis) = Tie mint fi(6;55-1)- 


| 
Theorem B-3. (Extension— Partial Converse). Let H lack situation-inter- 


dependence, let (g,s) be an equilibrium of (I, S, f, H)**, and let R(i, H,) = 
S — R(i, H;) for all i. If for alli there isno s’ €[R(i, H,) \ P(i,g)] for 
which 

f(s’) > f(s) 
then (g,s) is an equilibrium of (I, S, f)*. 
Proof. From (3), 

B*(i,g) = {§€ Pig) |f* (6) 2f*() forall S€P(i,g)} 


= {$E[PUZARG ANNES) 2 FG) 
forall S€[P(i,g)) R(i, A;)]}}. 
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By definition 
B(i,g) = {§ © Pli,g)|f(S) = F(S) forall F€ P(i,g)}. 


Thus B (i, g) will differ from B* (i, g) iff there is an 5 €[ P(i,g) N R(i,H, )] 
which provides a greater payoff to i than any situation in B*(i,g). Since 
(g,s) is an equilibrium of (/, S, f, H)**, s © B*(i, g) for all i. By hypothesis, 
then, there is no § €[ P(i,g) M R(i, H;)] which provides a greater payoff to i 
than any situation in B*(i,g). Thus for all i, B*(i,g) = B(i,g). Since 
s €1), B*(i,g),s ©, Bli,g), and by goodness (g,s) is an equilibrium of 
Sf = 


Corollary. If R(H) = S and (g,s) is an equilibrium of (I, S, f, H)**, then 
(g, 5) is an equilibrium of (I, S, f)*. 


Ill 


It is difficult to think of plausible situation-interdependent ways to restrain 
commitments. The only common situation-interdependent constraint, as 
far as we know, is that which arises in mixed strategy games when com- 
mitments can be made only in pure strategies. The commitment on every 
mixed strategy situation, then, is constrained to be exactly a weighted aver- 
age of the commitments on pure strategies. Rather strong results can be 
achieved for games of this type. 

We will need some different notation. Let (/, S, f) denote a pure strategy 
game. Its mixed strategy extension is (/, P, F) where 


P, = {p; = (pilsi), pi(S),--- Pi (87) | pi (st) = 0 
forall kK and X72, p,(st)=1} 


m, = |S;| 

Pi=se AE 
i=I 

BoP 


Fi(p) = & he pis fo 


F(p) = (Fi (Pp), Fa(P),---s Fn(P)). 


Even though situations are the product of mixed strategies, commitments 
can only be made in pure strategies: i.e., g must be subtracted from /. Ifa 
commitment g is made in pure strategies, payoffs to mixed strategies are 
given by: 
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(Gey = > | psu —g;)(s) 


ses 


j= 


so 


Gp) = >, | pis) a (5) 


2 = 
If we take H; to be the constraint on G,(-) that there be some g;,(-) that 
satisfies (5), then (J, P, F, H)** is a constrained commitment game of the 
type that has been the subject of this appendix. 

We are interested, then, in the circumstances under which (G, p) will be 
an equilibrium of (J, P, F, H)**. Through (5), though, every pure strategy 
commitment pattern g determines uniquely a mixed strategy commitment 
pattern G. Thus it will not be a serious abuse of notation to speak of (g, p) 
as an equilibrium of (J, P, F, H)** if (G,p) is an equilibrium and G is 
derived from g by (5). Such notation is considerably more convenient. 

We will proceed by several lemmas to show that equilibria in these mixed 
strategy games are merely probability combinations of pure strategy equi- 
libria. 


Lemma B-7. If (g, p) is an equilibrium of (I, P, F, H)** ands ¢ A(i,g) in 
(LS, f — g) for some i, then 11}, p;(s;) = p(s) =9. 


Proof. Suppose s ¢ A(i,g). Then there is some §; © S; such that 
(fi — 8) Gi, 5-1) > (f;, —8:)(). 


If p;(s;) = 0, then p(s) =0 and there is nothing more to prove. So suppose 
p;(s;) > 0. Then define 5;(-) in the following manner: 


P(s;) = 0 
Psi) = Pi(5;) + P;(S;) 
B(5;) = p(5;) otherwise 
Then 
Ce GIO.P-) = Cia GO) T1 ais)Letsoh, — gi)(s) 
+ pi(Si) Ki — 8:) Gio 5-1) 
— (iG) +piG)Gi — 8) Gi5-)] 
= (Fi — G)(P) + PONG — 8) Gi.s-)-Gi — 8:)(s)] 


which is greater than (F; — G;)(p) unless p(s) =0. Thus unless p(s) = 0, 
p will not be acceptable to iin (J, P, F— G) and hence (g, p) will not be an 
equilibrium. @ 
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Lemma B-8. If (g, p) is an equilibrium of (I, P, F, H)** ands € B(i,g) (in 
(1, S, f)*), then 
F,(p) S fi(s). 
Proof. We first show that p(§) > 0 only if § € P(i,g). For suppose s’ ¢ 
P(i,g). Then s’ € A(i,g) for some i and hence by Lemma B-7, p(s’) = 0. 
Thus F(p) is a weighted average of f,(§) for § © P(i,g). But by defini- 
tion of goodness 
f(s) =F (8) forall § € P(i,g). 
Thus /; (s) is greater than any weighted average of f; (5). @ 
Lemma B-9. If (g,p) is an equilibrium of (I, P, F, H)** ands € B(i,g), 
then 
(F; — G;)(p) = fils). 


Proof. Suppose (F; — G;) (p) < f(s), s © B(i,g). We will construct a 
(g, P) that beats (g, p) through 7. Construct p as 


p,(s;) = 1 for all 7. 
Construct g¢ as 

& = 8; for all j #i 

&(s) =0 


£(5) = 4G) forall §# s. 
It is easy to see that 
(F, — G)(b) = fils) > (F, — G)(p); 


thus we need only show that p € N (G ): 
Since 


(F; — G))(p) = f(s) = (Fi — G,) (Bi, B-i) = BASF As) for all p, 
we know that p € A(i, G). 


For j ¥ i, it follows from s € B(i,g) that s © P(i,g) and s € A(j,g); 
that is 


Cf, —8))(s) = Gy — 8) Gs), VS, SiS;- 
Then 


(F,— G)(b) = (f-8,)s) = (B- GB; 5) 
= > bG)(G—-g) G55) 
BES, 


and hence f € A(j, G). Thus p € N( G) and (g, Pp) beats(g,p)throughi. 
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Lemma B-10. If (g,p) is an equilibrium of (I, P, F, H)** ands € B(i,g), 
then 
=i p) and! iG.(p) (0: 


Proof. From Lemmas B-8 and B-9, if (g,p) is an equilibrium and s € 
Bii, g), 


CEG) UP) == 7,(5) = Ep). 
Thus 
GCP) — 0 and) f(s) = Fi (p). 
| 
Theorem B-4. If (g,p) is an equilibrium of (I, P, F, H)** and p(s) > 0, 
then (g,s) is an equilibrium of (I, S, f)*, and (F — G)(p) = F(p) = f(s). 


Proof. Since (g, p) is an equilibrium and p(s) > 0, it follows from Lemma 
B-7 that s © A(j, g) for all j and s © P(i, g) for all i. 

Suppose, then, that for some i, s ¢ B(i,g). Since P(i,g) is not empty, it 
contains some § which is good: 


SE Big), fi(S) > fils). 
By Lemma B-10 

Si(S) = F(p). (6) 
By Lemma B-7, p(5) > 0 only if 5 € N(g); thus 

Fi(p) = POA +PSs)+ Y p&) F£@. 


SEN(g) 
5H#s 
545 
Since pits) > 0, p(s) + xXp(s) < 1. Smee Ss € Nig), Ss © PGs) and 
Fi(S) 2 f,(S), since $ is good, and f,($) > f(s). 
Thus F;(p) > f;(8) which contradicts (6). 
Thus we must conclude that s € B(i,g) for all i and hence (g,s) is an 


equilibrium of (J, S, f)*. Since s € B(i,g), for all i, Lemma B-10 requires 
f(s) = F(p) and G(p) =0. 

a 

Theorem B-5. If (g,s) is an equilibrium of (I, S, f)* and p is given by 
P(s)=1  foralli 

then (g, p) is an equilibrium of (I, P, F. H)**. 
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Proof. Suppose (g,s) is an equilibrium of (/, S, f)*. We must show: 


(a) p€&N(G) and 
(b) (g,p) is not beaten. 


Ad (a). We must show p € A(i, G) for all i. Suppose p € A(i, G) for 
some i. Then there must be some §, € S; such that increasing p(5,,s_, ) 
and correspondingly decreasing p(s) increases (F,; — G,)(-). But this can 
be the case only if 


Cf, — 8) Gi.5-1) > Gf, —2,)(s) 


i.e., only if s € A(i,g). But if s € A(i,g), s € N(g), and (g,s) is not 
an equilibrium. Since this contradicts our hypothesis, we have shown that 
p © N(g). 


Ad (b). Suppose (g, p) beats (g, p) through player 7. Then 
(F, — Gi)(B) > (Fi — Gi)(P) = fis) 

so that 
Fi(p) > fi(s). 


Then there must be some § for which f;(§) > f;(s) and p(S) > 0. Since 
f(§) > f(s), and s © B(i,g), § € P(i, g); thus there must be some j ¥/ for 
whom § € A(j,g). Since g; = g; by definition of beating 


5 € A(j,8) 
and so there is some S$; € S; for which 
(4; — 8) Gj.54) > G-§) 6). 
Since f(§) > 0, p; (5;) > 0. Consider f,(-) defined by 
P(S)) = BS) + BS) 
P,(5;) = 0 
B(5;) = PS) otherwise 
Then 
(F; — G))(5),bs) = (Fy — GB) + TT Ace) x 
[Ai(5) (4G — 8) G55) -B BG - 8) 8) 
= (F- GA) + BOG -—H)G 5) -G -—HOI 
> (F, — G)(p), 
so that p ¢ A(j, G). Hence p ¢ N(G) and (g,p) is not beaten. @ 
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Thus we see from Theorems B-4 and B-5 that the pure-strategy game 
(I, S, f)* tells us practically everything we need to know about the con- 
strained mixed-strategy extension (J, P, F, H)**. All equilibria in the pure- 
strategy game are equilibria in the mixed, and the only equilibria in the 
mixed game that are not equilibria in the pure are probability combinations 
of equilibria in the pure. Payoffs are always the same, and when a pure 
commitment pattern has only one situation in equilibrium with it, the cor- 
respondence is perfect. 


IV 


We have seen that the axiom of free disposal of utility is not unduly restric- 
tive. Equilibria from free-disposal games carry over easily into constrained- 
disposal games, and constrained-disposal games have equilibria unrelated 
to free-disposal equilibria only in fairly rare circumstances. Moreover, for 
every constrained-disposal game (J, S, f, H)** there is a free-disposal game 
(I, S, f*)* that behaves the same way. 

Since plausible constraints on commitments are hard to come by, free- 
disposal presents no serious problem. 


C s Newcomb’s Problem 


“Timeo Daniaos et dona ferentes” 


Virgil, Aeneid 


Suppose that a superior being has appeared on Earth, with all the appro- 
priate science-fiction trappings, and claimed to be able to predict flawlessly 
what human beings will do. Its claim has been tested on a fabulously large 
number of occasions, and never been found to be false. 

One day it approaches you and puts two boxes in front of you. In box 1 it 
puts $1,000. You cannot see what it put in box 2, but this is what it tells 
you: “You may take either box 2 alone and keep its contents, or take both 
boxes and keep their contents. But remember this: if I predicted that you 
would take box 2 only I put $1 million in it; if I predicted that you would 
take both boxes, box 2 is empty. So long now.” Then it leaves. 

You sit and ponder. In a while, two wise and trusted friends stop by. 
You explain the situation and ask their advice. The first says, “Maximize 
your expected utility. Taking both boxes almost certainly results in getting 
$1,000. Taking only box 2 almost certainly yields $1 million. Therefore, 
take only box 2.” The second friend says, “Taking both boxes is a sure 
thing. Whatever the predictor did (and it’s done now), you’re $1,000 better 
off if you take both boxes. If it put $1 million in box 2, taking both boxes 
gives you $1,001,000 but taking box 2 only gives you only $1 million. If it 
didn’t put anything in box 2, taking both boxes gives you $1,000 but taking 
box 2 only gives you nothing. So take both.” 

The first friend replies: “Thousands of people just like you have gone 
through this experiment. Everyone who took only what was in box 2 ended 
up with $1 million. Everyone who listened to the sure-thing argument and 
took both boxes ended up with $1,000. All of them were no more pre- 
dictable and no smarter than you.” 

The second friend replies: “The predictor has already made its prediction, 
placed the $1 million in the box or not, and left —all this happened an hour 
ago. Box | is transparent. You and I both see $1,000 sitting there. You do 
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not know what is in box 2, but you do know that what is there now is exactly 
the same thing that was there an hour ago. If the money is already there, it 
will stay there whatever you choose. It is not going to disappear. If it is not 
already in the box, your choosing only box 2 will not make it suddenly 
appear. So why should you pass up the $1,000 which you plainly see?” 


I 


This is Newcomb’s problem. It was first brought to public attention by 
Nozick (1970), and has been the subject of a rising level of discussion since 
then. The apparent conflict between the expected utility maxim and the 
sure-thing maxim has intrigued philosophers, and supporters of neither 
side have claimed a clear-cut victory. Snow (1976) and Horgan (1981) have 
argued for the expected utility maxim (take box 2 only), while Nozick, in 
his original discussion, tentatively supported the sure-thing maxim (take 
both boxes). Gibbard and Harper (1978), Lewis (1979), Cartwright (1979), 
and Skryms (1980) have also argued for the sure-thing maxim. 

Taking both boxes is what one would do if the rest of the world satisfied 
secularity, as it usually does in such circumstances. It is only because the 
predictor’s fantastic past record raises questions about whether secularity 
still holds that one can entertain the single-box solution. After all, the argu- 
ment for that solution is that the predictor cares what we do, and therefore 
has arranged or will arrange matters so that if we take both boxes box 2 
will be empty. 


II 


A game-theoretic analysis can make all these points quite clear, and illu- 
minate the matter far better than a discussion in decision-theoretic terms. 
Newcomb’s problem is largely a game of strategy, and should not be treated, 
as philosophers have been wont to treat it, as a game against nature. As a 
game, Newcomb’s problem is quite easy to deal with, and we will not even 
need to consider commitments (other than Mother Nature’s). 

The game tree for Newcomb’s problem is presented in figure 11. Mother 
Nature moves first, and as usual we will assume that we know her commit- 
ment (on this last assumption, more later). Mother Nature’s decision is 
whether or not the predictor has abnormal powers. If the predictor does not 
have abnormal powers (vertex x, ), then it moves next, decides whether or 
not to put $1 million in box 2, and after it acts you take either both boxes or 
box 2 only. If the predictor has abnormal powers (vertex x,) you act first 
and then the predictor decides how much to put in box 2. When you move, 
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you do not know what Mother Nature and the predictor have done; thus all 
your vertices (x,,x;, and x,) are in the same information set. Your payoffs 
(the top numbers in figure 11) are those given by the Newcomb story assum- 
ing you are risk neutral; the predictor’s are derived from the assumption, 
which seems to be implicit in the Newcomb story, that it is merely trying to 
display technical virtuosity. Thus the predictor’s payoff is one at those end- 
points (z,, Z;, Z;, and z,) where it appears to have predicted correctly, and 
zero otherwise. 

We will take a behavioral strategy for Mother Nature to be a probability 
p that the predictor has abnormal powers, a behavioral strategy for you to 
be a probability q of taking both boxes, and a behavioral strategy for the 
predictor to be a triplet (1,, ¢,, ,) where 1, is the probability of leaving box 
2 empty at the information set identical to vertex i. Thus the payoff func- 
tions for you and the predictor, f”(-) and f”(-) respectively, are: 


fT’ (p.4.t) = 1000 pqt, + 1,001,000 pg (1 — 4) 
+ 1,000,000 p(1 —q)(1 —1,) + 1000(1 —p) qr 
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The perfect Nash equilibria of this game are: 


Typet: p<.001, g=1, h =1, 4 =1, 4=0 
Type 2: p>.001, g=0, 4, =0, t, =1, t, =0 
Type 3: p=.001, g<'s, 4h =0, 4 =1, 4, =0 
Type 4: p=.001, g='s,5H <1, ,=1, 4, =0 
Type 5: p=.001, g>'h, h=1, 4 =1, 4, =0 


Thus when there is a significant chance that Mother Nature has given the 
predictor abnormal powers (type 2), the predictor is rational to put $1 mil- 
lion in box 2 as long as it does not see that you will take both boxes, and 
you are rational to take only box 2. When the chance that Mother Nature 
has given the predictor abnormal powers is insignificant (type 1), then the 
predictor will be rational to leave box 2 empty and you will be rational to 
take both boxes. When p is exactly .001, a variety of situations are possible. 


Ill 


Thus the key question is what is the probability that Mother Nature has 
given the predictor abnormal powers. Whether the sure-thing maxim or the 
expected utility maxim holds sway over decision theory is entirely irrele- 
vant. The question that matters is extra-rational, as we termed it in chapter 
5, and answerable only in the realm of science and epistemology. 

Our analysis of rationality can provide some assistance, though, in an- 
swering this question, if only by indicating blind alleys. In particular, it 
shows that the predictor’s record of making correct predictions shows almost 
nothing about the value of p. From the perfect Nash equilibria we can see 
that as long as p # .001 the predictor will always be right. Even if p = .001 
(an event of zero probability in some sense), the predictor will be right at 
least 50% of the time and possibly all the time. I myself could compile a 
perfect record as a predictor like this. 
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